Calibration-Constrained Diagnostics for Evaluating LLM Self-Evaluation
cs.AI
Submitted: 2026-11-01
Updated: 2026-11-03
Code: https://github.com/calibration-constrained-diagnostics/selfeval-diagnostics
Terminology
Sources
- The Amazon Nova Family of Models: Technical Report and Model Card
- On the Measure of Intelligence
- Language Models (Mostly) Know What They Know
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- Metacognition is all you need? Using Introspection in Generative Agents to Improve Goal-directed Behavior
- Qwen2.5 Technical Report
- Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvement
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents