When Expert Disagreement Hurts: Prestige and Selectivity in LLM Decision Revision
cs.AI, cs.CL
Submitted: 2026-11-12
Updated: 2026-11-12
Code: https://github.com/yupengtang/when-expert-disagreement-hurts
Terminology
Sources
- Who Do LLMs Trust? Human Experts Matter More Than Other LLMs
- The Llama 3 Herd of Models
- Mistral 7B
- Language Models (Mostly) Know What They Know
- Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generation
- Are You Sure? Challenging LLMs Leads to Performance Drops in The FlipFlop Experiment
- BrokenMath: A Benchmark for Sycophancy in Theorem Proving with LLMs
- The Hypocrisy Gap: Quantifying Divergence Between Internal Belief and Chain-of-Thought Explanation via Sparse Autoencoders
- Simple synthetic data reduces sycophancy in large language models
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents