Auditing Pairwise Equivalence Judgments: Self-Critique Effects and Diversity Measurement in Multi-Agent Hypothesis Generation

cs.AI

Submitted: 2026-10-02

Updated: 2026-10-02

Comments: Accepted at the Agentic AI for Biological Discovery Workshop at NeurIPS 2026

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Sources

• Non-Determinism of "Deterministic" LLM Settings
• LAB-Bench: Measuring Capabilities of Language Models for Biology Research
• Scaling Test-time Compute for LLM Agents
• Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judge
• Know Thy Judge: On the Robustness Meta-Evaluation of LLM Safety Judges

Related papers

• MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
• Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
• Agents' Last Exam
• The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
• MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
• Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems