Argmin AIArgmin AI
About usOptimize your agent
RLHFBasic RAGPrompt OptimizationAgentic RAGQuantizationSafety BenchmarksLLM-as-a-JudgeChain-of-ThoughtMulti-Agent SystemsFunction CallingEfficient InferenceHallucination Detection

Survey: using graph structure to make RAG more precise, concise, and context-aware

Retrieval Augmented Generation (RAG)Knowledge Graph RAGBenchmark ConstructionSurvey
August 15, 20248 min

Overview

Decision SnapshotNeeds Validation

GraphRAG is a rapidly maturing approach with practical demos in industry; expect moderate engineering cost for graph construction and scalable retrieval, and clear gains in tasks where relations matter.

Citations22

Evidence Strength0.60

Confidence0.80

Risk Signals9

Trust Signals

Findings with numeric evidence: 6/6

Findings with evidence refs: 6/6

Results with explicit delta: 0/0

Reproducibility

Status: Partial assets available

Open source: Partial

At A Glance

Cost impact: 60%

Production readiness: 40%

Novelty: 60%

Authors

Boci Peng, Yun Zhu, Yongchao Liu, Xiaohe Bo, Haizhou Shi, Chuntao Hong, Yan Zhang, Siliang Tang

Links

Abstract / PDF / Code

Why It Matters For Business

GraphRAG injects relational facts into LLM outputs, reducing hallucination and shortening input prompts; this improves accuracy for QA, search, and domain workflows while leveraging existing graph databases.

Who Should Care

CTOML EngineerProduct ManagerData ScientistFounder

Summary TLDR

This paper is the first systematic survey of Graph Retrieval-Augmented Generation (GraphRAG). GraphRAG extends text-based RAG by indexing and retrieving graph elements (nodes, triples, paths, subgraphs) and converting them into formats LMs can consume. The authors organize research into three stages—G-Indexing, G-Retrieval, G-Generation—cover core methods (graph/text/vector/hybrid indexing; non-parametric/LM/GNN retrievers; graph languages and embeddings; hybrid GNN+LM generators), benchmarks, industry systems, and open challenges like scalable retrieval, dynamic graphs, multimodality, and context compression. The repo link and many literature pointers are provided for quick follow-up.

Problem Statement

Text-only RAG misses structured relations, produces redundant long context, and struggles to capture global relational context. GraphRAG aims to retrieve structured graph elements to supply relational knowledge, reduce verbosity, and improvefaithful, context-aware generation.

Main Contribution

First comprehensive survey of GraphRAG methods and applications.

Formalizes GraphRAG pipeline into three stages: G-Indexing, G-Retrieval, G-Generation.

Key Findings

GraphRAG workflow decomposes into three repeatable stages: Graph-Based Indexing, Graph-Guided Retrieval, and Graph-Enhanced Generation.

Numbers3 stages

Practical UseWhen building GraphRAG, split work into indexing, retrieval, and generation modules and optimize each independently.

Evidence RefSections 4, 5-7

Retrieval granularity strongly affects trade-offs: nodes/triples are fast but narrow; paths/subgraphs capture richer context but explode combinatorially.

Numbersgranularities: nodes, triplets, paths, subgraphs

Practical UseStart with node/triplet retrieval for latency-critical apps; use path/subgraph retrieval for multi-hop reasoning and accept higher compute cost.

Evidence RefSection 6.3

What To Try In 7 Days

Prototype a small text-attributed graph from internal docs and index it in Neo4j.

Implement a two-stage retriever: fast non-parametric seed (BFS/PCST) + LM or cross-encoder reranker.

Feed concise graph language summaries (edge table or node sequences) to an LLM prompt and compare accuracy vs. text-only RAG.

Agent Features

Memory
Graph database as long-term structured memoryCommunity summaries as compressed global context
Planning
LLM-generated reasoning pathsAgentic hop prediction to stop retrieval
Tool Use
Graph DB traversal (BFS/DFS)SPARQL/Cypher queriesLLM function-calling for retrieval
Frameworks
LlamaIndexLangChainNeo4j + NaLLMNebulaGraph GraphRAG
Architectures
GNN + LM (hybrid)GNN cascaded into LMParallel GNN + LM fusion
Collaboration
GNN encoders working with LMsMulti-stage retriever + reranker pipelines

Optimization Features

Token Efficiency
Summaries/community reports to shorten promptsGraph languages (adjacency/edge tables) to compress structure
Infra Optimization
Use vector indices (LSH) for fast nearest-neighbor lookupLeverage graph DB traversal for structural queries
Model Optimization
Prompt/prefix tuning for LMsLightweight GNN variants
System Optimization
Hybrid indexing (graph + vector + text) for latency/recall trade-offs
Training Optimization
Distant supervision for retriever pathsContrastive pretraining for passage/subgraph embeddings
Inference Optimization
Multi-stage retrieval to reduce LM callsConstrained decoding for valid KB queries

Reproducibility

Code AvailableYes
Data AvailableNo
Open Source StatusPartial
LicenseUnknown

Code URLs

https://github.com/pengboci/GraphRAG-Surveyhttps://github.com/microsoft/graphraghttps://github.com/eosphoros-ai/DB-GPThttps://github.com/neo4j/NaLLM

Risks & Boundaries

Limitations

Most methods tested on small graphs; large-scale industrial graphs remain challenging.

Converting graphs into LM-input formats can produce long contexts that LMs mishandle.

When Not To Use

When your problem is pure text retrieval with no relational reasoning needs.

When you cannot afford graph construction and maintenance costs.

Failure Modes

Over-retrieval: returning huge subgraphs that exceed token limits and confuse the LM.

Poor retrieval precision when entity linking is noisy, causing wrong evidence to drive answers.

Core Entities

Models

GPT-4GPT-3LLaMALLaMA2Qwen2RoBERTaBERTSentenceBERTGCNGATGraphSAGEGraph TransformerGreaseLMENGINEG-RetrieverGNN-RAGGRAGKG-GPT

Metrics

Exact Match (EM)F1AccuracyRecallMRRHits@KBERTScoreGPT4ScoreBLEUROUGE-LNDCG@K

Datasets

GRBENCHGraphQAWebQSPWebQuestionsCWQGrailQACSQAConceptNetWikidataFreebaseDBpediaCMeKGCPubMed-KGHotpotQASTaRKCRAG

Benchmarks

GRBENCHSTaRKCRAG

You May Also Want to Read

Turn an LLM output into a mini knowledge graph, check each fact with an NLI model, and get explainable hallucination flags

0.70
0.50
0.60
6

GraphEval pinpoints which facts in an LLM output are ungrounded and raises automatic detector accuracy, enabling targeted fixes and cheaper, explainable QA for production systems.

Key finding

Adding GraphEval to NLI-based detectors raises balanced accuracy on three summarization benchmarks.

Numbers: avg +6.2 balanced-accuracy (SE=1.3) across SummEval, QAGS‑C, QAGS‑X

Combine LLMs with a medical knowledge graph to get more accurate, verifiable scientific answers

0.50
0.60
0.60
1

FactFinder reduces hallucinations and improves completeness for domain questions by combining proprietary graph data with an LLM, making it useful for research teams that need verified, up-to-date facts quickly.

Key finding

Hybrid KG+LLM retrieval achieved good precision on node retrieval.

Numbers: Precision ≈ 78% on the 69-sample dataset

Use a personal causal graph so an LLM recommends foods that better lower your post-meal glucose

0.40
0.60
0.50
1

Personalized causal reasoning makes LLM-driven dietary advice measurably more tailored and stable for multi-hour glucose control; that can improve product trust and clinical usefulness compared to one-size-fits-all LLM responses.

Key finding

Personalized causal-graph method outperforms RAG baselines on longer horizons.

Numbers: 1h MGR 158.21 vs ChatDiet 120.45 (p=0.046); 2h MGR 411.56 vs 307.12 (p≈1e-4).

A practical survey showing how knowledge graphs can make LLMs better at complex question answering

0.60
0.40
0.60
0

Combining KGs with LLMs reduces hallucinations and adds verifiable evidence for high-stakes QA, but it raises compute and maintenance costs—trade accuracy and traceability against latency and budget.

Key finding

Using KGs in three roles (background, guideline, refiner) is the dominant design pattern for combining KGs with LLMs in QA.

MindMap: prompt LLMs with knowledge-graph evidence to produce explicit graph-style reasoning and reduce hallucination

0.60
0.70
0.50
11

MindMap makes LLM outputs more factual and inspectable by forcing the model to reason over KG-derived evidence graphs; this reduces hallucination risk in knowledge-heavy apps like medical assistants and increases trust.

Key finding

MindMap improves semantic match (BERTScore F1) on a clinical QA set (GenMedGPT-5k) compared to GPT-3.5 and other retrievers.

Numbers: BERTScore F1: MindMap 0.7954 vs GPT-3.5 0.7800 (Table 2)