Behavioral History Outperforms Descriptions of the Person for LLM Synthetic Personas
cs.AI, cs.CL, cs.CY
Submitted: 2026-10-02
Updated: 2026-10-12
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: Large language models (LLMs) are increasingly used as synthetic personas representing survey respondents.
Abstract
Large language models (LLMs) are increasingly used as synthetic personas representing survey respondents. Their validity as substitutes for particular respondents depends on whether they reproduce individuals' decisions. We examine what information helps synthetic respondents predict each individual's later choices, using five conditions that add progressively richer information: no personal information, demographics, personality traits, cognitive scores, and finally the respondent's earlier survey choices as behavioral history. We use a two-wave panel of 845 US adults who completed measures of 14 behavioral biases (spanning risk, time preferences, overconfidence, and reasoning), so each respondent's earlier answers provide a human test-retest benchmark; in the behavioral-history condition, all items that score the target bias are withheld. At the population level, the average number of biases per respondent in every condition is close to the human average (7.1-8.1 biases, against 7.1 for humans). This aggregate similarity masks differences in variance: persona descriptions recover only 53-67% of human between-person variation, whereas adding behavioral history restores it to approximately the human level. At the individual level, description-based personas achieve only 7-12% of the informedness observed in human test-retest responses, while adding behavioral history raises this to 28%. The condition including behavioral history has the highest estimated informedness in all 17 demographic groups, whereas description-based conditions provide little or no information for some groups. Synthetic responses also exhibit stronger education- and income-related differences than human responses. For LLM synthetic personas, a respondent's past answers add more to individual-level prediction than a description of who they are.
Sources
- Item-Mean Surrogates: Why Richer Persona Data Fail to Improve LLMs as Human Surrogates
- When Synthetic Users Fail: A Cross-Domain Benchmark of LLM-Simulated Human Survey Responses
- Pay What LLM Wants: Can LLM Simulate Economics Experiment with 522 Real-human Persona?
- When Persona Attributes Improve Population Alignment in Large Language Models
- From Demographics to Survey Anchors: Evaluating LLM Agents for Modeling Retirement Attitudes
- The Challenge of Using LLMs to Simulate Human Behavior: A Causal Inference Perspective
- When Can Digital Personas Reliably Approximate Human Survey Findings?
- Synthetic Personalities: How Well Can LLMs Mimic Individual Respondents Using Socio-Economic Microdata?
- The Memorization Problem: Can We Trust LLMs' Economic Forecasts?
- Plausible but Not Valid: A Psychometric Audit of LLMs as Synthetic Survey Respondents
- LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individuals
- When Can LLM Digital Twins Reduce Human Measurement? From Behavioral Fidelity to Statistical Substitutability
- The Chameleon's Limit: Investigating Persona Collapse and Homogenization in Large Language Models
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems