Large Language Models Substantially Compress Well-Being Inequality but Largely Preserve Its Socioeconomic Structure
cs.AI
Submitted: 2026-09-27
Updated: 2026-09-27
Comments: 28 pages, 3 figures
Code: https://github.com/npowdthavee/LLM_wellbeing_inequality
License: http://creativecommons.org/licenses/by/4.0/
The gist: Research using large language models (LLMs) to generate synthetic populations has repeatedly shown that model outputs compress the diversity of human experience.
Terminology
Abstract
Research using large language models (LLMs) to generate synthetic populations has repeatedly shown that model outputs compress the diversity of human experience. This has raised doubts about whether LLM-generated data can capture meaningful differences within populations. We show that such compression does not necessarily erase the social structure of human heterogeneity. Using 93,901 respondents from 66 countries and territories in Wave 7 of the World Values Survey, we ask six LLMs to predict respondents' life satisfaction from demographic, socioeconomic, and attitudinal profiles. All six models substantially understate the overall dispersion of life satisfaction. Yet after normalizing for these differences in scale, they largely reproduce the human income gradient in well-being inequality: lower-income groups remain relatively more heterogeneous than higher-income groups. The pattern is robust to country fixed effects, equal-country weighting, WVS survey weights, and observed demographic composition, and it extends directionally to employment, education, and perceived control. Fidelity is weaker for extreme outcomes and country-specific gradients. These results show that the amount of heterogeneity preserved by an LLM and the way that heterogeneity is distributed across social groups are distinct properties. LLM-generated populations can therefore substantially compress human variation while retaining meaningful information about where that variation is concentrated.
Sources
- Beyond Averages: Evaluating LLMs on Human Survey Replication at the Distributional Level
- Statistical realism is not evidence that LLMs can estimate treatment effects in social science experiments
- Large Language Models as Virtual Survey Respondents: Evaluating Sociodemographic Response Generation
- Large language models accurately predict public perceptions of support for climate action worldwide
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems