Thinking Before Thinking: Scaling Agentic Inference Through Meta-Reasoning
cs.AI
Submitted: 2026-09-29
Updated: 2026-09-29
Code: https://github.com/alexzhang13/rlm
License: http://creativecommons.org/licenses/by/4.0/
The gist: As agents take on longer and more complex problems, controlling the execution becomes a task in its own right.
Abstract
As agents take on longer and more complex problems, controlling the execution becomes a task in its own right. Each step in the run brings new control choices, like which partial work to build on, whether to start fresh, or when to stop. We introduce agentic meta-reasoning, an inference-time harness that makes these choices an explicit and structured reasoning process. Workers carry out the task-level computation, while a controller consolidates what the run has established, explores next options, assesses what each option is worth under the remaining budget, and dispatches the chosen work with context drawn from persistent memory. Between decisions the controller carries only a compact account of the run rather than replaying its full history. Our baselines span production coding agents and research harnesses, together with a Direct Control Agent using the same workers and compute budget allowance. On ProgramBench, which tests long-horizon agentic capability through program reconstruction, meta-reasoning achieves 71.5% with GPT-5.5 against 58.0% for Codex; with Opus 4.8 it achieves 67.2% against 65.5% for Claude Code. On the other benchmarks, spanning abstract reasoning, multi-domain long-horizon reasoning, and proof generation, it gains between 3.6 and 4.2 points over direct control, averaged across three frontier models. It keeps improving over the tested budget ranges where direct control plateaus, though its overhead can hurt at small budgets. Artifact-graph analysis reveals more reuse of earlier work, higher coverage of correct solutions in most settings, and nonuniform gains in final selection. These results indicate that spending computation on structured control becomes more important as agents scale to longer runs.
Sources
- Oolong: Evaluating Long Context Reasoning and Aggregation Capabilities
- Large Language Monkeys: Scaling Inference Compute with Repeated Sampling
- LLMs Know When They Know, but Do Not Act on It: A Metacognitive Harness for Test-time Scaling
- Why Do Multi-Agent LLM Systems Fail?
- Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory
- ARC-AGI-2: A New Challenge for Frontier AI Reasoning Systems
- Rational Metareasoning for Large Language Models
- Meta-R1: Empowering Large Reasoning Models with Metacognition
- PRO-LONG: Programmatic Memory Enables Long-Horizon Reasoning
- AgentEval: DAG-Structured Step-Level Evaluation for Agentic Workflows with Error Propagation Tracking
- An LLM Compiler for Parallel Function Calling
- Meta-Harness: End-to-End Optimization of Model Harnesses
- Adaptive Tool Use in Large Language Models with Meta-Cognition Trigger
- Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnesses
- Metacognition in LLMs: Foundations, Progress, and Opportunities
- Lost in the Middle: How Language Models Use Long Contexts
- Self-Refine: Iterative Refinement with Self-Feedback
- LongCoT: Benchmarking Long-Horizon Chain-of-Thought Reasoning
- Monitor-Generate-Verify (MGV): Formalising Metacognitive Theory for Language Model Reasoning
- MemGPT: Towards LLMs as Operating Systems
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems