Do Large Language Models Show Racial and Sex Bias in Pain Management? A Counterfactual Audit of GPT, Claude, Gemini, Llama, DeepSeek and Qwen
cs.CL, cs.AI, cs.CY
Submitted: 2026-11-11
Updated: 2026-11-11
Code: https://github.com/ricyoung/qpain-llm-counterfactual-audit
Terminology
Sources
- Bias in Large Language Models Across Clinical Applications: A Systematic Review
- Large language models perpetuate bias in palliative care: development and analysis of the Palliative Care Adversarial Dataset (PCAD)
- EQUITRIAGE: A Fairness Audit of Gender Bias in LLM-Based Emergency Department Triage
- Artificial Intolerance: Stigmatizing Language in Clinical Documentation Skews Large Language Model Decision-Making
- Non-Determinism of "Deterministic" LLM Settings
- Instability Floors: Separating Bias from Noise in Fairness Audits of Clinical LLM Agents with FairMedAgent
- PAINT: A Framework for Multilingual Pain Representation from Medical Licensing Exams to Real-World Clinical Texts
- Secure On-Premise Deployment of Open-Weights Large Language Models in Radiology: An Isolation-First Architecture with Prospective Pilot Evaluation
- Counterfactual Auditing of Bias in Open-Source Large Language Models for Clinical Triage
- Training language models to follow instructions with human feedback
- What's in a Name? Auditing Large Language Models for Race and Gender Bias
- Name-Bias in Large Language Models
- Counterfactual Fairness
- Bias patterns in the application of LLMs for clinical decision support: A comprehensive study
- Aligning (Medical) LLMs for (Counterfactual) Fairness
- FairMedQA: Benchmarking Bias in Large Language Models for Medical Question Answering
- Beyond Accuracy: Counterfactual Fragility and Demographic Bias in Clinical Evaluation of LLMs
- From Promising Capability to Pervasive Bias: Assessing Large Language Models for Emergency Department Triage
- Gemma 3 Technical Report
- Qwen3 Technical Report
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data