Overview
Production Readiness
0.6
Novelty Score
0.6
Cost Impact Score
0.7
Citation Count
0
Why It Matters For Business
Treating LLMs as agents unlocks real-world automation: models can call tools, check work, store experience, and coordinate—cutting manual glue code and raising automation value across search, coding, science, and operations.
Summary TLDR
This survey defines "agentic reasoning": treating LLMs as agents that plan, act (call tools), and learn over time. It organizes work into three layers—foundational (planning, tool use, search), self-evolving (feedback and memory), and collective (multi-agent coordination)—and two optimization modes: in-context (no parameter change) and post-training (SFT/RL). The paper reviews representative systems, benchmarks, and real applications (math, science, robotics, healthcare, web agents), highlights practical patterns and system designs, and outlines open problems such as long-horizon credit assignment, world-models, scalable multi-agent training, personalization, and governance.
Problem Statement
LLMs perform well on closed, static reasoning tasks but fail to act, adapt, or improve in open-ended, dynamic environments. We need methods that turn passive text generation into iterative decision loops where models plan, call tools, use memory, integrate feedback, and coordinate across agents.
Main Contribution
Formalize "Agentic Reasoning" as three layers: foundational, self-evolving, collective.
Systematic review of methods for planning, tool use, search, memory, and feedback.
Contrast two optimization modes: in-context orchestration vs post-training (SFT/RL).
Catalog applications, benchmarks, open problems, and practical design patterns.
Key Findings
Agentic systems center reasoning as an explicit think-then-act loop.
Large-scale supervised fine-tuning has been used to teach tool use at scale.
Reinforcement learning improves adaptive, outcome-driven tool policies beyond imitation.
Structured memory and role-aware multi-agent memory can materially improve long-horizon tasks.
Results
Accuracy
Who Should Care
What To Try In 7 Days
Prototype a plan-then-act prompt that separates 'thought' and 'action' for a common task.
Add a simple validator (e.g., unit test) to loop until a passing result for code generation.
Attach a small workflow memory (saved snippets) to reuse prior successful steps in repeated tasks.
Agent Features
Memory
- flat retrieval memory (vector DB)
- structured memory (graphs, workflows)
- learned memory control (RL memory managers)
Planning
- in-context planning (Tree-of-Thoughts, workflow prompts)
- post-training planning (RL, reward shaping)
- formal plan representations (code/PDDL)
Tool Use
- in-context tool invocation (documented APIs)
- SFT
- RL-based multi-tool mastery
- orchestration frameworks (HuggingGPT, ToolPlanner)
Frameworks
- LangChain
- LlamaIndex
- ToolLLM
- HuggingGPT
- AutoAgents
- Agent-Q
Is Agentic
true
Architectures
- plan-then-act pipelines
- planner-executor (hierarchical)
- tree-search / MCTS-based planning
- role-based multi-agent pipelines
Collaboration
- role decomposition (manager/worker/critic)
- router-based agent selection
- topology optimization and pruning
Optimization Features
Token Efficiency
- workflow compression
- memory summarization (sleep-time compute)
- tool documentation to reduce prompt size
Infra Optimization
- use smaller model for tool selection (GEAR pattern)
- amortize expensive tool-makers vs cheap tool-users
Model Optimization
- SFT
- GRPO
System Optimization
- planner-executor decoupling
- tool orchestration with hierarchical planners
- agent routing and graph pruning
Training Optimization
- self-supervised API annotation (Toolformer)
- distillation on improved trajectories
- pretraining with simulated tool dialogues
Inference Optimization
- in-context search / Tree-of-Thoughts
- verifier-guided reranking & self-consistency
- delegating selection to smaller LMs for cost savings
Reproducibility
Code Available
Open Source Status
- partial
Risks & Boundaries
Limitations
- Survey: synthesizes many works but does not provide unified empirical comparisons.
- Benchmarks vary in scope and the field lacks standard long-horizon evaluation protocols.
- Practical guidance can require substantial engineering to instantiate (tooling, validators, memory systems).
When Not To Use
- For simple one-shot classification or short prompt tasks where no external action is needed.
- Where strict privacy/regulatory constraints forbid external tool calls and shared memories.
- When compute or latency constraints disallow the multi-step search/reflection loops.
Failure Modes
- Compounding errors in long-horizon plans leading to derailment.
- Hallucinated tool calls or incorrect parameterization when tool docs are insufficient.
- Multi-agent coordination instability, misrouting, and incentive misalignment.
- Silent latent reasoning (invisible chains) that hinders audit and debugging.
Core Entities
Models
- ReAct
- Tree-of-Thoughts
- Reflexion
- Voyager
- Toolformer
- ToolLLM
- WebGPT
- MemGPT
Metrics
- task success / pass rate
- validator acceptance (unit tests)
- recall / retrieval fidelity
- Accuracy
Datasets
- GSM8K
- MATH
- GSM-style math datasets
- ToolQA
- APIBench
Benchmarks
- ToolBench (various)
- WebArena
- WebWalker
- MemBench / LongMemEval
- AgentBench / MultiAgentBench
Context Entities
Models
- Gorilla
- Agent-Q
- DeepResearcher
- AlphaEvolve
- Mem0
Metrics
- API invocation correctness
- citation-grounded synthesis quality
- multi-agent coordination stability
Datasets
- ToolAlpaca tool dialogues (3,938 instances)
- MTU-Instruct (54,798 dialogues)
- APIBench (1,645 APIs, 16,450 instruction-API pairs)
Benchmarks
- ToolFlow (multi-step tool tasks)
- WebRL / WebAgent-R1
- Mind2Web 2
- PaperQA