Multi-Estimate Elicitation Does Not Uniformly Debias Language Model Judgments
cs.CL, cs.AI
Submitted: 2026-10-31
Updated: 2026-11-17
Code: https://github.com/asj252/llm-judgment-studies
Terminology
Sources
- Diversity is the Strength of the AI Crowd
- Meaningless is better: hashing bias-inducing words in LLM prompts improves performance in logical reasoning and statistical learning
- Self-Blinding and Counterfactual Self-Simulation Mitigate Biases and Sycophancy in Large Language Models
- Rescaling confidence: What scale design reveals about LLM metacognition
- Understanding the Anchoring Effect of LLM with Synthetic Data: Existence, Mechanism, and Potential Mitigations
- Hearsay or Fact? How Framing and Elicitation Shape LLM Probability Updates
- Same Answer, Different Confidence: Protocol Sensitivity in LLM Confidence Calibration
- Bayesian artificial brain with ChatGPT
- Dual Traits in Probabilistic Reasoning of Large Language Models
- Hindsight Bias in Clinical Temporal Reasoning: How Future Data Exposure Affects Large Language Model Judgment
- Confidence Calibration in Large Language Models
- Will the Real Linda Please Stand up...to Large Language Models? Examining the Representativeness Heuristic in LLMs
- Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversity
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data