Overview
The design is practical and plug‑and‑play, tested across three MAS frameworks and three LLMs on five benchmarks; empirical gains are consistent but limited to evaluated domains and depend on LLM quality.
Citations0
Evidence Strength0.80
Confidence0.85
Risk Signals9
Trust Signals
Findings with numeric evidence: 4/4
Findings with evidence refs: 4/4
Results with explicit delta: 4/4
Reproducibility
Status: Code + data available
Open source: Partial
At A Glance
Cost impact: 65%
Production readiness: 70%
Novelty: 60%
Why It Matters For Business
G‑Memory turns multi‑agent systems from static workflows into systems that learn from past team interactions, giving notable accuracy and success gains without redesigning existing MAS frameworks.
Who Should Care
Summary TLDR
G-Memory is a plug‑and‑play hierarchical memory layer for LLM-based multi-agent systems (MAS). It stores past interactions at three levels—interaction (utterances), query (task records), and insight (distilled lessons)—and retrieves role‑specific memory via upward (to insights) and downward (to core trajectories) traversals. Across five benchmarks and three MAS frameworks, adding G-Memory improves embodied action success and QA accuracy substantially (up to +20.89% and +10.12% on evaluated benchmarks) while keeping token cost modest. The code is public.
Problem Statement
Current MAS lack expressive, agent‑aware memory. Existing memories are simplistic (only inside‑trial logs or final artifacts) and fail on long multi‑agent trajectories. This prevents MAS from learning from past collaborations and improving over time.
Main Contribution
Diagnose a bottleneck: multi-agent systems lack hierarchical, role‑aware cross‑trial memory.
Propose G-Memory: a three‑tier, graph‑based memory (insight, query, interaction) with bi‑directional traversal and agent‑specific filtering.
Key Findings
Largest observed task gain: G-Memory raised an embodied action success rate by +20.89%.
Knowledge QA accuracy improved by up to +10.12% on evaluated datasets.
Results
| Metric | Value | Baseline | Delta | Split / Dataset | Evidence | Evidence Ref |
|---|---|---|---|---|---|---|
| success rate | 79.10% | 58.21% | +20.89% | ALFWorld (MacNet, Qwen-2.5-14b) | Table 3: MacNet + Qwen-2.5-14b row shows 58.21% → 79.10% | Table 3 |
| Accuracy | 34.61% | 24.49% | +10.12% | HotpotQA (AutoGen, Qwen-2.5-14b) | Table 3: AutoGen + Qwen-2.5-14b HotpotQA row shows 24.49% → 34.61% | Table 3 |
What To Try In 7 Days
Integrate G‑Memory as a plug‑in to one MAS (AutoGen/DyLAN/MacNet) on a development branch.
Run a small replay of past tasks and inspect retrieved insight and trajectory snippets.
Compare end‑to‑end task success and token usage vs current memory baseline over 50 trials.
Agent Features
Memory
Planning
Tool Use
Frameworks
Is Agentic
Yes
Architectures
Collaboration
Optimization Features
Token Efficiency
System Optimization
Inference Optimization
Reproducibility
Code URLs
Risks & Boundaries
Limitations
Evaluation limited to five benchmarks (embodied action, PDDL, HotpotQA, FEVER); more domains (e.g., medical QA) not tested.
Performance depends on base LLM quality; retrieval and distillation can amplify LLM errors.
When Not To Use
Small single‑agent tasks where MAS overhead outweighs benefit.
Privacy‑sensitive settings where storing interaction transcripts is disallowed.
Failure Modes
Retrieval noise from excessive hop expansion introducing irrelevant insights.
Compressed interaction graphs missing critical dialogue steps (sparsifier errors).