When Evidence Changes the Subject: Subject-Typed Claim Licensing for Learned Routing
cs.AI
Submitted: 2026-09-27
Updated: 2026-09-27
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
The gist: Modern learned systems increasingly combine learned components with search, repair, or external solvers.
Terminology
Abstract
Modern learned systems increasingly combine learned components with search, repair, or external solvers. Benchmarks often measure the resulting end-to-end system, while scientific claims may concern only one component, creating an attribution problem: evidence can fail to support the requested component-level claim while still supporting a positive conclusion about the larger system. Existing evidence-to-claim methods primarily calibrate claim strength. We argue that composite systems require a second dimension: scientific subject. We address this problem with subject-typed claim licensing, which separates weaker conclusions about the requested subject from positive but non-substitutive credit about another subject. We instantiate this idea in SCOPE-Routing for preference-conditioned multigraph routing. Non-authors reproducibly apply the declared semantics; held-out review yields fewer reference-relative upward deviations than unstructured review, while the difference from a strong evidence checklist remains unresolved; and a controlled routing study shows that score-optimal and claim-eligible methods can differ while valid hybrid-system credit is preserved. These results motivate treating claim strength and scientific subject as distinct dimensions of evidence-based evaluation.
Sources
- Neural Combinatorial Optimization with Reinforcement Learning
- From Statute to Control Flow: Span-Grounded Deontic Trees for Defeasible Scope Parsing
- The Benchmarking Epistemology: Validity Theory for Evaluating Machine Learning Models
- Attention, Learn to Solve Routing Problems!
- DataSP: A Differential All-to-All Shortest Path Algorithm for Learning Costs and Predicting Paths with Context
- The Calibration Turn in AI-Assisted Research: A Conceptual and Methodological Framework for Evidence-Licensed Claims
- Holistic Evaluation of Language Models
- Regression with Multi-Expert Deferral
- Measurement to Meaning: A Validity-Centered Framework for AI Evaluation
- FactReview: Evidence-Grounded Peer Review with Execution-Based Claim Verification
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems