Overview
Production Readiness
0.4
Novelty Score
0.65
Cost Impact Score
0.45
Citation Count
4
Why It Matters For Business
STRIDE turns LLMs into reliable decision engines for algorithmic planning tasks by pairing language reasoning with small, auditable tools and memory; this lowers risk in automation that needs exact calculations or incentive-aware pricing.
Summary TLDR
STRIDE is an LLM-centered agent framework that combines a structured reasoning loop (Thought sequence), an external working memory, and small domain tools (Python functions) so the LLM can reliably emulate algorithms (value iteration, UCB-VI, backward induction, Minimax) in strategic decision problems. Across tabular MDPs, dynamic mechanism design, and bargaining games, STRIDE with one demonstration substantially outperforms plain Chain-of-Thought and code-interpreter baselines on success rates and converges as fast as algorithmic references. The code is public.
Problem Statement
LLMs make good natural-language reasoning but fail at precise algorithmic steps needed in strategic, multi-step decision tasks (wrong math, forgetting long context, poor exploration, weak opponent modeling). The paper asks: can we wrap an LLM with memory plus small tools and a control loop so it reliably executes algorithmic strategies in strategic environments?
Main Contribution
STRIDE framework: structured Thought units + operational tools + external working memory controlled by an LLM.
Procedure to generate demonstrations that show the LLM how to call tools to emulate reference algorithms (value iteration, UCB-VI, dynamic VCG, backward induction, Minimax).
Empirical eval across tabular MDPs (known/unknown), dynamic mechanism design, single-issue bargaining (complete and incomplete info), and games (Tic-Tac-Toe, Connect-N) showing large gains over CoT baselines.
Key Findings
STRIDE finds optimal actions in tabular MDPs far more often than CoT baselines when given a single demonstration.
In unknown-model MDPs, STRIDE explores effectively and matches the reference UCB-VI algorithm's convergence speed.
STRIDE computes dynamic VCG mechanisms (multi-agent pricing + policy) significantly more accurately than baselines.
STRIDE reaches subgame-perfect / sequential equilibrium in bargaining far more often than CoT baselines.
When playing head-to-head games, STRIDE that emulates Minimax achieves very high win rates against plain LLM baselines.
STRIDE needs small, hand-designed tools and demonstrations; it is not purely zero-shot and depends on these artifacts.
Results
MDP optimal-action success rate (H=5,S=3,A=3)
MDP cumulative reward convergence (unknown model)
Dynamic VCG success rate (N=4)
SPE success rate in complete-info bargaining (T=6)
SE success rate in incomplete-info bargaining (T=6)
Head-to-head Tic-Tac-Toe (STRIDE vs zero-shot CoT)
Who Should Care
What To Try In 7 Days
Identify one small decision task (e.g., pricing or simple planning).
Implement 4–6 Python primitive ops (value update, argmax, model update) for that task.
Create one demo Thought trace showing tool calls for a solved instance and test STRIDE with your LLM on 20 random cases.
Agent Features
Memory
- external working memory for parameters and intermediate results
Planning
- structured Thought sequence (multi-step planning)
- emulation of algorithmic planners (value iteration, UCB-VI, backward induction, Minimax)
Tool Use
- operational tools for arithmetic/model updates
- interaction tools to convert text to environment actions
Frameworks
- STRIDE
- ReAct
- Reflexion
- RAFA
Is Agentic
true
Architectures
- LLM controller + external working memory + tool set
Optimization Features
Token Efficiency
- reduces context token load by storing large matrices in working memory
System Optimization
- decouples operation names from arguments to reduce LLM errors
Reproducibility
Code Urls
Code Available
Open Source Status
- partial
Risks & Boundaries
Limitations
- Requires hand-designed operational tools for each problem domain.
- Evaluations are on small tabular environments; scaling to large state spaces is untested.
- Framework depends on accurate function implementations; tool bugs directly affect decisions.
- Relies on LLM function-calling behavior that may vary across model versions.
When Not To Use
- If you cannot build or audit small deterministic tools for the domain.
- For very large-scale continuous state/action spaces without compact primitives.
- When you need fully end-to-end learned policies with minimal engineering.
Failure Modes
- Tool outputs or argument selection errors can lead the LLM to incorrect reasoning.
- Incorrect demonstrations can teach the LLM wrong operation sequences.
- Working memory corruption or mis-indexing large matrices may cause silent failures.
Core Entities
Models
- GPT-3.5-Turbo-0125
- GPT-4o-2024-05-13
- GPT-4
Metrics
- success rate
- cumulative reward per episode
- SPE/SE reach rate
- avg sale price
- tie/win/loss percentages
Benchmarks
- tabular MDPs
- dynamic VCG mechanism design
- alternating-offer bargaining
- Tic-Tac-Toe
- Connect-N