Terminal-style Mathematical Modeling Bench: The First Agentic and Verifiable Benchmark for Mathematical Modeling
cs.CL
Submitted: 2026-11-05
Updated: 2026-11-05
Code: https://github.com/wxj630/terminal-bench-math-modeling
Project page: https://www.tbench.ai
Terminology
Sources
- MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering
- Training Verifiers to Solve Math Word Problems
- FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI
- BLADE: Benchmarking Language Model Agents for Data-Driven Science
- InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks
- AutoKaggle: A Multi-Agent Framework for Autonomous Data Science Competitions
- Toward a Trustworthy Optimization Modeling Agent via Verifiable Synthetic Data Generation
- MM-Agent: LLM as Agents for Real-world Mathematical Modeling Problem
- Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces
- ModelingAgent: Bridging LLMs and Mathematical Modeling for Real-World Challenges
- PaperBench: Evaluating AI's Ability to Replicate AI Research
- A Survey of Optimization Modeling Meets LLMs: Progress and Future Directions
- DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Search
- Benchmarking Data Science Agents
- Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data