RECAST: Learning to Compute the Right Context through Adaptive Evidence Routing
cs.AI
Submitted: 2026-10-07
Updated: 2026-10-07
Comments: 35 pages, 2 figures, 13 tables
License: http://creativecommons.org/licenses/by/4.0/
The gist: Large language models are increasingly applied to tasks grounded in long, heterogeneous information sources.
Abstract
Large language models are increasingly applied to tasks grounded in long, heterogeneous information sources. Conventional Retrieval-Augmented Generation (RAG) relies on fixed similarity-based retrieval, while agentic variants adapt queries and tool use but remain largely retrieval-centric. However, in many tasks, the evidence required for a solution is not explicitly present in any single source item. Instead, it must be derived through filtering, aggregation, or computation across multiple source items. In this work, we introduce RECAST (Routing Evidence through Computation, Access, and Synthesized Tools), a learned framework that formulates evidence construction as a sequential decision process over heterogeneous retrieval and computation operations, allowing evidence to be actively derived rather than merely retrieved. A lightweight RouterLM iteratively selects and formulates primitive operations or specifies customized operations for a frozen CompilerLM to translate into executable code. Once it judges the evidence sufficient, RouterLM passes the accepted evidence to a frozen AnswerLM to produce the final solution. We train RouterLM with supervised fine-tuning (SFT) followed by group relative policy optimization (GRPO). Across six heterogeneous benchmark families, RECAST achieves a mean success rate of 75.6%, outperforming the strongest large-model baseline by 15.9%. Moreover, training enables the Qwen3.5-9B RouterLM to outperform a training-free Gemini 3.5 Flash RouterLM by 5.0%. On three held-out benchmarks, RECAST improves over the strongest baseline by 15.0% on average, demonstrating strong zero-shot generalization across tasks and heterogeneous source representations.
Sources
- Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Tasks
- Binding Language Models in Symbolic Languages
- LoRA: Low-Rank Adaptation of Large Language Models
- TAPEX: Table Pre-training via Learning a Neural SQL Executor
- WebGPT: Browser-assisted question-answering with human feedback
- MemGPT: Towards LLMs as Operating Systems
- ART: Automatic multi-step reasoning and tool-use for large language models
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- Corrective Retrieval Augmented Generation
- ReAct: Synergizing Reasoning and Acting in Language Models
- Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflow
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems