RMA: Context-Orchestrated Research Math Agents
cs.AI, cs.LG
Submitted: 2026-05-20
Updated: 2026-09-30
Comments: Code: https://github.com/sjtuytc/ResearchMathAgent
Code: https://github.com/sjtuytc/ResearchMathAgent
License: http://creativecommons.org/licenses/by/4.0/
The gist: Long-horizon mathematical reasoning fails less often because a model cannot produce a valid next step than because an agent fails to maintain and expose the right semantic state across many
Terminology
Abstract
Long-horizon mathematical reasoning fails less often because a model cannot produce a valid next step than because an agent fails to maintain and expose the right semantic state across many iterations. Left unmanaged, this produces research-level proofs that are locally convincing yet globally incomplete: a key lemma unproved, an assumption unchecked, a citation unsupported, or a computational claim unverified. We present Research Math Agents (RMA), an agentic framework for long-horizon proof development built around a persistent, typed research store and an orchestrator that compiles operation-specific context from that store. The Research Context Orchestrator is the central state-management layer between the persistent research store and each locally scoped proof operation: it retrieves task-relevant artifacts, compiles them into a bounded context, invokes the appropriate operation, and writes the resulting proof edits, issue updates, literature notes, plans, or evaluations back to the store. This process is designed to keep proof revisions, unresolved issues, prior attempts, literature, and evaluations available across rounds while exposing only task-relevant state to each local operation. We evaluate RMA across complementary research-level settings using independent expert evaluation, blind mathematician review, LLM-based benchmark evaluation, and Lean 4 kernel verification. RMA achieves a 42.5% solve rate on the independently evaluated SOOHAK Challenge Hard set, obtains 8 of 10 correct solutions on First Proof B1 and 8 of 10 passing solutions on B2 under human-expert evaluation, and verifies 213 of 300 sampled Research Solved targets in Formal Conjectures with the Lean 4 kernel.
Sources
- Llemma: An Open Language Model For Mathematics
- Towards Autonomous Mathematics Research
- The Agentic Researcher: A Practical Guide to AI-Assisted Research in Mathematics and Machine Learning
- First Proof
- Step-Wise Formal Verification for LLM-Based Mathematical Problem Solving
- Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMs
- First Proof Second Batch
- Seed-Prover 1.5: Mastering Undergraduate-Level Theorem Proving via Learning from Experience
- Training Verifiers to Solve Math Word Problems
- Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Models
- Generative Language Modeling for Automated Theorem Proving
- REAL-Prover: Retrieval Augmented Lean Prover for Mathematical Reasoning
- Hilbert: Recursively Building Formal Proofs with Informal Reasoning
- MemGPT: Towards LLMs as Operating Systems
- ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memory
- Exploring Advanced LLM Multi-Agent Systems Based on Blackboard Architecture
- ProofCouncil: An LLM Agent for Solving Open Mathematical Problems
- Escaping the Cognitive Well: Efficient Competition Math with Off-the-Shelf Models
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems