Overview
Results show consistent gains on a new benchmark and two external simulators, but the approach relies on many LLM calls and domain-limited tests.
Citations5
Evidence Strength0.80
Confidence0.85
Risk Signals9
Trust Signals
Findings with numeric evidence: 4/4
Findings with evidence refs: 4/4
Results with explicit delta: 5/5
Reproducibility
Status: Code + data available
Open source: Yes
At A Glance
Cost impact: 50%
Production readiness: 60%
Novelty: 60%
Why It Matters For Business
TDAG reduces failure cascades and improves partial progress tracking, so agent-driven multi-step workflows are more reliable and auditable.
Who Should Care
Summary TLDR
This paper introduces TDAG, a multi-agent system that (1) dynamically decomposes a complex task into subtasks that can change as results arrive, and (2) auto-generates tailored subagents (via LLM prompting) for each subtask. The authors pair TDAG with ItineraryBench, a travel-planning benchmark that scores partial progress across three levels (executability, constraint satisfaction, efficiency). On ItineraryBench TDAG averages 49.08 vs baselines ~43–45, and ablations show both dynamic decomposition and agent generation are important. Code and data are available.
Problem Statement
LLM-based agents struggle on long, multi-step real-world tasks because fixed task decompositions cause error propagation and manually built subagents lack adaptability. Existing benchmarks often report only binary success/failure and miss partial progress.
Main Contribution
ItineraryBench: a travel-planning benchmark with 364 test scenarios and fine-grained, three-level scoring.
TDAG: a multi-agent framework that dynamically adjusts task decomposition and generates subagents tailored per subtask.
Key Findings
TDAG achieves higher average score on ItineraryBench than baselines
Removing components degrades performance
Results
| Metric | Value | Baseline | Delta | Split / Dataset | Evidence | Evidence Ref |
|---|---|---|---|---|---|---|
| ItineraryBench average score | 49.08 (TDAG) | ReAct 43.02 | +6.06 | ItineraryBench (avg over Type1/2/3) | Table 2 reports scores per task type and average | Table 2 |
| Ablation: remove agent generation | 46.69 (TDAG w/o Agent Generation) | TDAG 49.08 | -2.39 | ItineraryBench (avg) | Table 2 ablation rows | Table 2 |
What To Try In 7 Days
Run ItineraryBench on your agent to measure partial-task performance.
Prototype dynamic decomposition: split a complex workflow and replan when a subtask fails.
Generate simple subagents via LLM prompts and add a small skill library for reuse.
Agent Features
Memory
Planning
Tool Use
Frameworks
Is Agentic
Yes
Architectures
Collaboration
Optimization Features
Token Efficiency
Reproducibility
Code URLs
Data URLs
Risks & Boundaries
Limitations
Benchmark focuses on travel planning; generality beyond tested simulators is limited.
Skill correctness in the library is not guaranteed and requires ongoing refinement.
When Not To Use
For cheap, single-step tasks where a single LLM is sufficient.
When token/compute budget cannot afford multiple generated subagents per task.
Failure Modes
Cascading failures if decomposition or replan logic is flawed.
Hallucinations causing external information misalignment with databases.