An Enigma of Artificial Reason: Investigating the Production-Evaluation Gap in Large Reasoning Models
cs.AI, cs.CL, cs.LG
Submitted: 2026-05-31
Updated: 2026-11-09
Terminology
Sources
- First Proof
- Understanding intermediate layers using linear classifier probes
- Remarks on the disproof of the unit distance conjecture
- JudgeLRM: Large Reasoning Models as a Judge
- ARC Prize 2024: Technical Report
- ARC-AGI-2: A New Challenge for Frontier AI Reasoning Systems
- Training Verifiers to Solve Math Word Problems
- Semi-Autonomous Mathematics Discovery with Gemini: A Case Study on the Erd\H{o}s Problems
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
- FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI
- MATH-Perturb: Benchmarking LLMs' Math Reasoning Abilities against Hard Perturbations
- Measuring Faithfulness in Chain-of-Thought Reasoning
- The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
- Improve Mathematical Reasoning in Language Models by Automated Process Supervision
- SpatialReasoner: Towards Explicit and Generalizable 3D Spatial Reasoning
- GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models
- OpenAI o1 System Card
- Intriguing properties of neural networks
- JudgeBench: A Benchmark for Evaluating LLM-based Judges
- Assessing Judging Bias in Large Reasoning Models: An Empirical Study
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents