STRIDE: give an LLM a memory and small tools and it reliably follows algorithms for strategic decisions

May 25, 20248 min

Overview

Decision SnapshotNeeds Validation

STRIDE is a practical, medium-effort pattern: you need to design small operation functions and one demonstration per new domain, after which the LLM reliably follows algorithmic reasoning; evidence is empirical on tabular, small-scale tasks.

Citations4

Evidence Strength0.80

Confidence0.85

Risk Signals10

Trust Signals

Findings with numeric evidence: 6/6

Findings with evidence refs: 6/6

Results with explicit delta: 5/6

Reproducibility

Status: Partial assets available

Open source: Partial

At A Glance

Cost impact: 45%

Production readiness: 40%

Novelty: 65%

Authors

Chuanhao Li, Runhan Yang, Tiankai Li, Milad Bafarassat, Kourosh Sharifi, Dirk Bergemann, Zhuoran Yang

Links

Abstract / PDF / Code

Why It Matters For Business

STRIDE turns LLMs into reliable decision engines for algorithmic planning tasks by pairing language reasoning with small, auditable tools and memory; this lowers risk in automation that needs exact calculations or incentive-aware pricing.

Who Should Care

Summary TLDR

STRIDE is an LLM-centered agent framework that combines a structured reasoning loop (Thought sequence), an external working memory, and small domain tools (Python functions) so the LLM can reliably emulate algorithms (value iteration, UCB-VI, backward induction, Minimax) in strategic decision problems. Across tabular MDPs, dynamic mechanism design, and bargaining games, STRIDE with one demonstration substantially outperforms plain Chain-of-Thought and code-interpreter baselines on success rates and converges as fast as algorithmic references. The code is public.

Problem Statement

LLMs make good natural-language reasoning but fail at precise algorithmic steps needed in strategic, multi-step decision tasks (wrong math, forgetting long context, poor exploration, weak opponent modeling). The paper asks: can we wrap an LLM with memory plus small tools and a control loop so it reliably executes algorithmic strategies in strategic environments?

Main Contribution

STRIDE framework: structured Thought units + operational tools + external working memory controlled by an LLM.

Procedure to generate demonstrations that show the LLM how to call tools to emulate reference algorithms (value iteration, UCB-VI, dynamic VCG, backward induction, Minimax).

Key Findings

STRIDE finds optimal actions in tabular MDPs far more often than CoT baselines when given a single demonstration.

NumbersExample: H=5,S=3,A=3 success rate STRIDE 0.98 vs 0.74 (best baseline)

Practical UseIf you need reliable algorithmic decisions in small MDPs, provide STRIDE one demo and operation functions to get near-optimal action selection.

Evidence RefTable 1

In unknown-model MDPs, STRIDE explores effectively and matches the reference UCB-VI algorithm's convergence speed.

NumbersCumulative rewards converge by ~10 episodes, similar to UCB-VI

Practical UseUse STRIDE to implement exploration-aware policies (e.g., UCB-style) when the model is unknown instead of relying on generic CoT prompts.

Evidence RefFigure 4

Results

MetricValueBaselineDeltaSplit / DatasetEvidenceEvidence Ref
MDP optimal-action success rate (H=5,S=3,A=3)0.98 (STRIDE)0.74 (best baseline: zero-shot CoT w/ code)0.24Table 1 configuration: H=5,S=3,A=3 (20 runs)STRIDE provided 1 demo and tools; averages reported over 20 random instancesTable 1
MDP cumulative reward convergence (unknown model)Converges by ~10 episodes (STRIDE ≈ UCB-VI)Baselines fail to converge reliably10 MDP instances, H=5, |S|=3, |A|=3, K=40 episodesSTRIDE emulates UCB-VI using UpdateMDPModel and bonus operationsFigure 4

What To Try In 7 Days

Identify one small decision task (e.g., pricing or simple planning).

Implement 4–6 Python primitive ops (value update, argmax, model update) for that task.

Create one demo Thought trace showing tool calls for a solved instance and test STRIDE with your LLM on 20 random cases.

Agent Features

Memory
external working memory for parameters and intermediate results
Planning
structured Thought sequence (multi-step planning)emulation of algorithmic planners (value iteration, UCB-VI, backward induction, Minimax)
Tool Use
operational tools for arithmetic/model updatesinteraction tools to convert text to environment actions
Frameworks
STRIDEReActReflexionRAFA
Is Agentic

Yes

Architectures
LLM controller + external working memory + tool set

Optimization Features

Token Efficiency
reduces context token load by storing large matrices in working memory
System Optimization
decouples operation names from arguments to reduce LLM errors

Reproducibility

Code AvailableYes
Data AvailableNo
Open Source StatusPartial
LicenseUnknown

Risks & Boundaries

Limitations

Requires hand-designed operational tools for each problem domain.

Evaluations are on small tabular environments; scaling to large state spaces is untested.

When Not To Use

If you cannot build or audit small deterministic tools for the domain.

For very large-scale continuous state/action spaces without compact primitives.

Failure Modes

Tool outputs or argument selection errors can lead the LLM to incorrect reasoning.

Incorrect demonstrations can teach the LLM wrong operation sequences.

Core Entities

Models

GPT-3.5-Turbo-0125GPT-4o-2024-05-13GPT-4

Metrics

success ratecumulative reward per episodeSPE/SE reach rateavg sale pricetie/win/loss percentages

Benchmarks

tabular MDPsdynamic VCG mechanism designalternating-offer bargainingTic-Tac-ToeConnect-N