RAGElo cuts expert labeling cost by using synthetic queries and LLM judges to rank retrieval-augmented systems, so teams can iterate and pick retrieval or fusion strategies faster while keeping a small human calibration step.
LLM-as-a-judge moderately matches human experts.
Numbers: Kendall τ ≈ 0.56, p < 0.01; Spearman ρ ≈ 0.59
VideoRAG enables searchable QA and summarization across many long videos, unlocking education, media-archive search, and customer-support video analytics without retraining large models.
VideoRAG wins more LLM head-to-head judgments than standard RAG baselines
Numbers: VideoRAG chosen 53.26% vs baselines' 46.74% (Overall Winner, Table 2)
A practical pipeline that trades some answer coverage for far fewer incorrect claims, which is often preferable in QA products where wrong answers are costly.
Full system flipped the Task 1 public score from strongly negative to positive.
Numbers: Score: Our 15.8% vs Official RAG -46.6% (Table 1)
A hybrid RAG layer plus a small abbreviation lookup can cut wrong answers and boost recall on internal technical queries, speeding engineering work and reducing time spent hunting docs.
Hybrid RAG substantially increases answer recall versus no retrieval.
Numbers: q2a-100: >40% recall improvement vs no-RAG; cmds-100: >60% recall improvement vs no-RAG
Specialized RAG reduces wrong answers on complex EDA docs, improving self-serve support and lowering costly human support for tooling documentation.
Domain-finetuned embedding improves dense retrieval recall.
Numbers: recall@20: 0.733 (ours) vs 0.66 (bge-large) and 0.634 (text-embedding-ada-002)
TSM makes assistants recall facts that happened when they actually happened, improving time-sensitive answers and multi-session personalization—this can reduce wrong or stale recommendations in customer support and personal assistants.
TSM raises overall QA accuracy on LONGMEMEVAL_S to 74.80%
Numbers: TSM 74.80% vs A-MEM 62.60% (+12.20 pp)
Automating literature review with a system that picks the right retrieval mode reduces manual search time and improves the relevance of extracted evidence. This matters for teams that need fast, evidence-grounded summaries across many papers (R&D, clinical review, IP) and want an auditable pipeline.
Agentic system with DPO substantially increases vector-store context recall.
Numbers: VS Context Recall +0.63 vs baseline
MemWeaver cuts inference token cost by >95% while improving time-sensitive and multi-hop accuracy, so you can support long-running personalized agents without huge prompt costs or loss of traceability.
MemWeaver reduces inference input length by over 95% compared to long-context prompting.
Numbers: >95% token reduction (22k → ~1k tokens per query)
If you build agents that must remember users and multi-session facts, a structured, timeline-aware memory reduces identity and temporal drift and improves preference stability across sessions.
BMAM achieves strong long-horizon dialogue accuracy on LoCoMo.
Numbers: 78.45% (1558/1986)
Tools that speak a local language well unlock use cases (education, news, local QA, civic services). A dedicated model + hybrid retrieval gives measurably better accuracy and cultural fit than off-the-shelf multilingual models.
A 35GB, 4.8M-document Punjabi corpus was assembled and used for training.
Numbers: 35.5GB corpus, ~4,800,000 documents, 32GB train / 2GB val / 1GB test
CarbonChat automates extraction and structured analysis of long sustainability reports and policy texts, cutting manual effort and providing traceable, SQL-queryable answers for decision-makers.
Self-Prompting RAG improves text-generation metrics vs standard RAG.
Numbers: Qwen-Max ROUGE-1 0.592 vs 0.529; BERTScore F1 0.906 vs 0.831
If your app uses mixed graph and text data, AF-Retriever gives large zero-shot retrieval gains and traceable answers without domain fine-tuning, saving dataset curation time while improving top-1 accuracy.
AF-Retriever substantially improves first-hit rates over previous zero-/one-shot methods on STaRK.
Numbers: Avg hit@1 increase vs second-best = 32.1% (abstract); AF-Retriever hit@1: 62.0% (Table 2 avg synthetic).
If you build knowledge products for niche domains, add retrieval plus keyword-aware retrieval to raise factuality and credibility without expensive model retraining.
RAG responses were strongly preferred over non-RAG responses by experts.
Numbers: 81% preference rate (reported by domain experts)
SKETCH gives more accurate, context-preserving retrieval for complex, multi-part queries, which improves downstream answers and traceability at the cost of higher KG construction and LLM use.
On the small Italian Cuisine test, SKETCH reached very high relevancy and precision.
Numbers: answer_relevancy=0.94; context_precision=0.99
XRAG helps teams identify which retrieval or reranking change actually improves end-to-end QA accuracy, reducing guesswork and wasted engineering time when deploying RAG-powered search or assistant features.
Combining hybrid retrieval (BM25 + vector) with re-ranking yields large retrieval gains.
Numbers: F1: 0.975 vs baseline 0.740 (Table 12)
You can raise domain accuracy of off-the-shelf LLMs without costly fine-tuning by adding a small retrieval corpus, re-ranking, and stepwise prompting, lowering risk and time-to-value for domain AI features.
GPT-4 score rose from 67% (base) to 90% with ARCoT.
Numbers: 67% → 90% (+23 percentage points)
Editable multimodal memory lets assistants evolve with users (names, images, preferences) and yields measurable accuracy gains on long conversations—helpful for retention and personalized UX.
M2A improves average correctness on the enhanced LoCoMo benchmark versus a single-pass RAG baseline
Numbers: GPT-4o-mini Avg: M2A 44.64% vs RAG 33.27% (≈+11.4 pp)
A.DOT reduces over-retrieval and exposes verifiable evidence for each step, cutting unnecessary data exposure and improving multi-step QA accuracy—helpful for compliance-heavy enterprise queries.
A.DOT improves answer correctness and completeness on HybridQA dev vs Standard RAG.
Numbers: Correctness +14.8p, Completeness +10.7p (Table 1)
Automates time-consuming test-document work, preserves traceability for regulated enterprise projects, and can shrink timelines and costs if you can manage integration and KB upkeep.
Agentic multi-agent RAG improves test artifact accuracy compared to Basic RAG.
Numbers: Basic RAG 65.2% -> Agentic RAG 94.8%
Automating tumour-board form filling can cut clinician paperwork and speed case preparation while keeping traceable links to source notes, but expect human review for ~20% of fields.
Best model achieved 80% correct field completion on evaluated cases.
Numbers: Pixtral-large-2502-v1 mean accuracy = 80%
If your product needs up-to-date or relational knowledge, rely on retrieval and structured graphs; naive LLMs overfit to pretraining and will miss recent multi-hop facts.
LLM-only prompting performs poorly on up-to-date, multi-hop questions.
Numbers: LLM-only accuracy ≈ 23–40% (Table 3)
Formal ontologies can make smaller models more dependable in specialist tasks, but only when retrieval reliably finds relevant definitions; otherwise, augmentation can reduce trust and accuracy.
OpenMath coverage is limited: only a minority of problems have high-quality matches.
Numbers: 24.2% problems with max reranker score ≥ 0.5; mean max score 0.2715
Aggregating evidence from multiple sources and retrieving negated queries expands coverage and surfaces disagreements, improving zero-shot claim checks and making automated decisions more transparent.
Retrieving both the claim and its negation (dual-perspective) improves zero-shot verification.
Numbers: +2–10% accuracy; +2–8% macroF1 (typical gains across datasets)
HELP preserves graph-style multi-hop accuracy while cutting retrieval latency up to ~28.8× on tested QA tasks, letting teams deploy knowledge-grounded LLMs at much lower cost and with faster response times.
HELP matches or slightly improves top GraphRAG accuracy while being much faster.
Numbers: Avg F1 55.3 vs HippoRAG2 54.6 on multiple QA datasets (Table 1)
