Overview
The approach is conceptually simple and effective on curated traces, but it needs broader datasets and automation for large-scale deployment.
Citations0
Evidence Strength0.80
Confidence0.90
Risk Signals9
Trust Signals
Findings with numeric evidence: 2/3
Findings with evidence refs: 3/3
Results with explicit delta: 2/2
Reproducibility
Status: Partial assets available
Open source: Partial
At A Glance
Cost impact: 35%
Production readiness: 60%
Novelty: 55%
Why It Matters For Business
You can audit autonomous agents to see which past memory or tool output caused a decision—useful for compliance, debugging, and fixing business rule violations without needing explicit failures.
Who Should Care
Summary TLDR
This paper presents a two-stage attribution framework that explains why an LLM-based agent produced a specific action. First it replays the agent trajectory component-by-component and scores the marginal likelihood gain to find high-impact components (temporal likelihood dynamics). Then it ablates sentences inside those components (probability drop & hold) to surface the exact textual evidence. The method is evaluated on eight curated agent trajectories (memory- and tool-driven scenarios) using Llama-3.1-70B-Instruct; a simple leave-one-out and linear baselines are compared. Code is released.
Problem Statement
Existing attribution work focuses on locating explicit failures. But many undesirable agent actions occur without an explicit error signal (for example a reasonable-looking refund or a privacy leak caused by a retrieved email). We need methods to explain which past memory entries, tool returns, or sentences actually drove a chosen action.
Main Contribution
A hierarchical agentic attribution framework: component-level temporal replay + sentence-level perturbation.
Component-level method: score marginal likelihood gains when incrementally revealing trajectory components.
Key Findings
Prob. Drop&Hold hits the human-labelled top sentence 93.75% of the time (Hit@1).
Multiple sentence-level attribution methods work well inside the framework; leave-one-out and ContextCite reach 81.25% Hit@1.
Results
| Metric | Value | Baseline | Delta | Split / Dataset | Evidence | Evidence Ref |
|---|---|---|---|---|---|---|
| Hit@1 (Prob. Drop&Hold) | 0.9375 | LOO 0.8125 | +0.125 | average across 8 curated cases | Table 1 reports Hit@1 = 0.9375 for Prob. Drop&Hold vs 0.8125 for LOO | Table 1 |
| Hit@3 (Prob. Drop&Hold) | 1.0 | LOO 0.9375 | +0.0625 | average across 8 curated cases | Table 1 reports Hit@3 = 1.0 for Prob. Drop&Hold | Table 1 |
What To Try In 7 Days
Run the component-level replay on a few real agent traces to surface high-impact steps.
Apply the probability drop&hold ablation to top components to surface the exact sentence that drove an action.
Use findings to add simple guards: ignore untrusted tool text, downweight single-case memories, or require explicit evidence before high-risk actions.
Agent Features
Memory
Planning
Tool Use
Frameworks
Is Agentic
Yes
Architectures
Reproducibility
Code URLs
Risks & Boundaries
Limitations
Evaluation uses eight curated cases and a single model (Llama-3.1-70B-Instruct), limiting generality.
Sentence-level ablation requires model likelihood access and can be costly on long contexts.
When Not To Use
When you cannot compute or compare model likelihoods for ablated inputs (closed APIs without log-probs).
As a fully automated monitor at large scale without further work to automate interpretation.
Failure Modes
Multiple components share influence and attribution may split credit ambiguously.
Agent self-contradiction or latent internal state can lead to misleading likelihood signals.