Overview
Simulation evidence across 330 tasks and 5 seeds supports claims. Real-world readiness is limited by perception gaps, static cost settings, and model latency.
Citations0
Evidence Strength0.70
Confidence0.80
Risk Signals9
Trust Signals
Findings with numeric evidence: 3/3
Findings with evidence refs: 3/3
Results with explicit delta: 4/4
Reproducibility
Status: No open assets linked
Open source: Unknown
At A Glance
Cost impact: 80%
Production readiness: 35%
Novelty: 70%
Why It Matters For Business
Robots or service agents that ask and recall before moving save time and energy. Halving navigation cost directly lowers operational expense and extends robot lifespan. Better trade-offs also reduce user annoyance from frequent interruptions.
Who Should Care
Summary TLDR
ESearch-R1 teaches a multimodal LLM agent to trade off asking the user, checking episodic memory, and navigating so it avoids costly physical search. A new RL algorithm (HC-GRPO) trains the agent by sampling groups of reasoning trajectories and reinforcing those that achieve high information gain at low heterogeneous cost. In AI2-THOR simulation, the approach keeps or improves success while cutting average task execution cost by roughly half compared to strong ReAct baselines.
Problem Statement
Standard MLLM agents treat thinking and moving the same. In real robots movement is expensive and human interruptions have social cost. Agents often either brute-force search or over-question, wasting time and attention. The problem: learn a policy that explicitly trades off information gain vs heterogeneous costs (navigation, asking, memory) so the agent resolves ambiguity cheaply.
Main Contribution
ESearch-R1: a unified decision framework that treats Ask, GetMemory, and Navigate as actions with explicit costs.
HC-GRPO: a group-relative RL algorithm for MLLMs that removes the need for a learned value critic and optimizes reasoning trajectories for cost-aware behavior.
Key Findings
ESearch-R1 cuts average operational cost by about half compared to a strong ReAct baseline.
Under high ambiguity (3–4 distractors), ESearch-R1 substantially raises success rate.
Results
| Metric | Value | Baseline | Delta | Split / Dataset | Evidence | Evidence Ref |
|---|---|---|---|---|---|---|
| Avg. Success Rate (SR) | 61.5% | ReAct (Qwen2.5-VL-32B) 60.0% | +1.5 pp | ESearch-Bench (avg over all tasks) | Table I, main results | Table I |
| Avg. Total Task Cost (TTC) | 1.6 | ReAct (Qwen2.5-VL-32B) 3.3 | -1.7 (≈50%) | ESearch-Bench (avg over all tasks) | Table I; RQ2 discussion | Table I |
What To Try In 7 Days
Implement a simple episodic memory (timestamped observations) and a one-question Ask action in your simulator.
Add per-action costs (navigate, ask, memory) to your reward and run short RL or policy search experiments to see behavior shifts.
Warm-start the policy with supervised CoT traces and then do a small group-sampling optimization loop like GRPO to prefer low-cost trajectories.
Agent Features
Memory
Planning
Tool Use
Frameworks
Is Agentic
Yes
Architectures
Collaboration
Optimization Features
Token Efficiency
Infra Optimization
Model Optimization
System Optimization
Training Optimization
Inference Optimization
Reproducibility
Risks & Boundaries
Limitations
Results are in simulation (AI2-THOR); real sensors and occlusion may reduce performance.
Cost function uses fixed coefficients; real deployments need dynamic or learned cost models.
When Not To Use
Settings where perception is unreliable (occlusion, noisy sensors) without additional robustness.
Tasks that cannot accept any human queries or memory logging.
Failure Modes
Premature navigation after partial or vague user answers, leading to wrong picks.
Over-reliance on simulated oracle behavior that mismatches real human responses.