When the Judge Should Not Decide: Evidence-Locked, Non-Compensatory Selection Bounds LLM-Judge Failure in Reasoning Pipelines
cs.AI
Submitted: 2026-08-07
Updated: 2026-10-16
License: http://creativecommons.org/licenses/by/4.0/
The gist: An LLM judge deployed inside a reasoning pipeline does not merely measure quality, it decides which answer ships.
Terminology
Abstract
An LLM judge deployed inside a reasoning pipeline does not merely measure quality, it decides which answer ships. We show that the cost of that decision depends less on judge accuracy than on the decision rule the judge is embedded in. On frozen candidate pools from four GRPO policies, an unconstrained scalar DeepSeek-R1-7B judge buys almost nothing over answer-level majority vote (+1.0 pp on 500 GSM8K questions, +0.34 EM on 300 HotpotQA questions), and on a frozen-rule 30-question confirmation split it is 10 points worse than majority, a judge that destroys accuracy while scoring candidates confidently. We then subordinate the same judge to Evidence-Locked Derive-Gate-Repair (EL-DGR), a task-adaptive non-compensatory rule under which a judge preference may override evidence-supported consensus only with an extractive evidence certificate, and a repair only when neither alternative is certified and the repair is. With no change to the judge, the candidates, or the budget, EL-DGR reaches 58.2% on GSM8K (vs. 56.8% judge, 55.8% majority, 55.4% first candidate) and 17.33 EM / 25.46 F1 on HotpotQA (vs. 15.67/23.49, 15.33/23.19, 15.33/22.97), improving on first-candidate GRPO by +2.8 pp (exact McNemar p=0.0026) and +2.00 EM (p=0.070, borderline). A decision audit shows why: EL-DGR overturns consensus on only 8 of 30 pilot questions and never converts a correct consensus into an incorrect answer. We also report what did not work: the same seven-channel decomposition used as a step-level gated training reward is null, and corrected channel-drop ablations show no channel is individually necessary (p=1.0 throughout). The practitioner-facing finding is negative about judges and positive about admissibility, bound the judge's blast radius rather than trying to make it accurate.
Sources
- Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection
- FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarios
- Training Verifiers to Solve Math Word Problems
- A Survey on LLM-as-a-Judge
- Let's Verify Step by Step
- Generative Adversarial Reasoner: Enhancing LLM Reasoning with Adversarial Reinforcement Learning
- SWIRL: A Staged Workflow for Interleaved Reinforcement Learning in Mobile GUI Control
- WebGPT: Browser-assisted question-answering with human feedback
- LLM Evaluators Recognize and Favor Their Own Generations
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- From <Answer> to <Think>: Multidimensional Supervision of Reasoning Process for LLM Optimization
- Large Language Models are not Fair Evaluators
- Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations
- Self-Consistency Improves Chain of Thought Reasoning in Language Models
- Mitigating LLM Hallucination via Behaviorally Calibrated Reinforcement Learning
- ReAct: Synergizing Reasoning and Acting in Language Models
- Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems