Overview
The method shows consistent gains on three public long‑context QA sets and ablations; costs and domain generality still need wider testing.
Citations0
Evidence Strength0.70
Confidence0.80
Risk Signals9
Trust Signals
Findings with numeric evidence: 4/4
Findings with evidence refs: 4/4
Results with explicit delta: 5/5
Reproducibility
Status: Partial assets available
Open source: Partial
At A Glance
Cost impact: 40%
Production readiness: 60%
Novelty: 60%
Why It Matters For Business
JERR improves answer accuracy and long‑range recall on long documents while producing an interpretable graph of facts; build once and reuse graphs to amortize cost.
Who Should Care
Summary TLDR
JERR is an agent-style pipeline that turns long documents into chunk synopses, deduplicates entities, builds a directed acyclic graph (DAG) of facts, then uses Monte Carlo Tree Search (MCTS) to pick the most relevant graph nodes for answering questions. On three long‑context QA benchmarks (QuALITY, MuSiQue, NarrativeQA) JERR improves accuracy and recall metrics versus retrieval and agent baselines. It costs more tokens during graph construction but supports graph reuse to cut per‑query cost.
Problem Statement
Transformer LLMs struggle to reason over very long inputs and to retrieve the small set of facts needed for complex questions. We need a practical, interpretable method that filters redundancy, preserves causal links, and finds relevant facts without retraining the LLM.
Main Contribution
JERR: a three-stage pipeline—synopsis extraction, deduplication + DAG graph construction, and MCTS-based graph search for reasoning.
A two-stage deduplication (Bloom Filter + Trie for exact matches, SimHash for near-duplicates) to compress facts before graph building.
Key Findings
JERR yields the best accuracy on QuALITY multi-choice QA.
JERR improves long‑range recall on multi‑hop QA (MuSiQue).
Results
| Metric | Value | Baseline | Delta | Split / Dataset | Evidence | Evidence Ref |
|---|---|---|---|---|---|---|
| Accuracy | 86.39% | GraphRAG 85.02% | +1.37 pp | QuALITY dev | Table 2 shows JERR 86.39% vs baselines | Table 2 |
| MuSiQue LR-1 / LR-2 / F1 | 0.455 / 0.595 / 0.505 | GraphRAG 0.410 / 0.550 / 0.488 | +0.045 / +0.045 / +0.017 | MuSiQue | Table 3 LR and F1 comparisons | Table 3 |
What To Try In 7 Days
Chunk a sample long document, extract synopses, and build a small DAG with Bloom+SimHash dedupe to test graph quality.
Run MCTS to pick top‑k nodes (k=5 default) and compare answers to a simple retrieval baseline.
Measure token and latency cost; test graph reuse to see per‑query savings.
Agent Features
Memory
Planning
Tool Use
Frameworks
Is Agentic
Yes
Architectures
Optimization Features
Token Efficiency
Reproducibility
Risks & Boundaries
Limitations
Validated only on QuALITY, MuSiQue and NarrativeQA; generalization to other domains unknown.
Relies on Qwen API for node extraction; graph quality depends on that pipeline.
When Not To Use
When per‑query token or latency budgets are very tight and you cannot amortize graph construction.
For short documents where full-context LLMs already handle the input efficiently.
Failure Modes
Noisy or incorrect node extraction leads to wrong edges and hallucinated answers.
MCTS may focus on keyword overlap and miss semantically relevant nodes if keywords are sparse.