When Is Proof-Step Verification Worth Its Cost? Operating Requirements of Certify-or-Decline Verification for Open-Weight Mathematical Reasoning
cs.AI, cs.CL, cs.LG
Submitted: 2026-11-10
Updated: 2026-11-10
Code: https://github.com/yashica-patodia/certify-or-decline
Terminology
Sources
- Theoria: Rewrite-Acceptability Verification over Informal Reasoning States
- Selective Classification for Deep Neural Networks
- Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
- When To Solve, When To Verify: Compute-Optimal Problem Solving and Generative Verification for LLM Reasoning
- Self-Consistency Improves Chain of Thought Reasoning in Language Models
- Deductive Verification of Chain-of-Thought Reasoning
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark
- MathArena: Evaluating LLMs on Uncontaminated Math Competitions
- Hard2Verify: A Step-Level Verification Benchmark for Open-Ended Frontier Math
- Measuring Mathematical Problem Solving With the MATH Dataset
- Let's Verify Step by Step
- Qwen3 Technical Report
- gpt-oss-120b & gpt-oss-20b Model Card
- Phi-4 Technical Report
- Reliability without Validity: A Systematic, Large-Scale Evaluation of LLM-as-a-Judge Models Across Agreement, Consistency, and Bias
- When Errors Become Narratives: A Longitudinal Taxonomy of Silent Failures in a Production LLM Agent Runtime
- Preference Leakage: A Contamination Problem in LLM-as-a-judge
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents