Aggregate Disambiguation Systems
stat.ME, cs.AI
Submitted: 2026-08-31
Updated: 2026-08-31
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- RoPoLL: Robust Panel of LLM Judges
- SCOPE: Selective Conformal Optimized Pairwise LLM Judging
- Nine Judges, Two Effective Votes: Correlated Errors Undermine LLM Evaluation Panels
- Calibrate, Don't Curate: Label-Efficient Estimation from Noisy LLM Judges
- Who can we trust? LLM-as-a-jury for Comparative Assessment
- Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judge
- Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models
- A Finite-Calibration Regime Map for LLM Judge Panels
Related papers
- Doubly robust inference via calibration
- Bayesian Empirical Bayes: Simultaneous Inference from Probabilistic Symmetries
- Weak-Form Recovery of Stochastic Generators
- Optimal Watermark Localization in Mixed-Source Large Language Model Texts
- Optimized Conformal Selection: Powerful Selective Inference After Data-Dependent Score Construction
- Small area learning