Socio-Foundation: A Model for Generalizable Individual Behavior Simulation via Hierarchical Capability Distillation
cs.AI
Submitted: 2026-10-06
Updated: 2026-10-06
Code: https://github.com/Lancelot-Xie/Socio-Foundation
License: http://creativecommons.org/licenses/by/4.0/
The gist: Simulating individual behavior requires large language models (LLMs) to preserve persona traits while adapting to dynamic social contexts.
Terminology
Abstract
Simulating individual behavior requires large language models (LLMs) to preserve persona traits while adapting to dynamic social contexts. However, general-purpose LLMs often flatten distinct personas, while task-specific tuning suffers from fragmentation and generalization. To overcome these challenges, we organize individual simulation into the FONTS Taxonomy, comprising five complementary capability dimensions: persona fidelity (F), outcome realization (O), behavioral naturalness (N), trajectory coherence (T), and social grounding (S). Grounded in this taxonomy, we curate a standardized training corpus library of approximately 10 million instances across 14 representative datasets and present Socio-Foundation. Socio-Foundation decouples specialization from integration via a three-stage pipeline: learning task experts via DAPO, consolidating them into capability experts via off-policy distillation, and unifying them via multi-teacher on-policy distillation (MOPD). We also establish IndiEval, consolidating 29 metrics across the FONTS dimensions. Experiments show that Socio-Foundation outperforms its Qwen3-8B base by 11.0 points and approaches frontier models such as GLM-5.2, with ablations and out-of-distribution evaluations further demonstrating the effectiveness and generalization of our model.
Sources
- On-Policy Distillation of Language Models: Learning from Self-Generated Mistakes
- Centaur: a foundation model of human cognition
- Scaling Synthetic Data Creation with 1,000,000,000 Personas
- BehaveGPT: A Foundation Model for Large-scale User Behavior Modeling
- Finetuning LLMs for Human Behavior Prediction in Social Science Experiments
- LLMs Get Lost In Multi-Turn Conversation
- HumanLLM: Towards Personalized Understanding and Simulation of Human Nature
- MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Training
- From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agents
- Unveiling the Truth and Facilitating Change: Towards Agent-based Large-scale Social Movement Simulation
- Flipping the Dialogue: Training and Evaluating User Language Models
- LLM Agents Grounded in Self-Reports Enable General-Purpose Simulation of Individuals
- Learning to Make MISTAKEs: Modeling Incorrect Student Thinking And Key Errors
- MORPHEUS: Modeling Role from Personalized Dialogue History by Exploring and Utilizing Latent Space
- Qwen3 Technical Report
- CURP: Codebook-based Continuous User Representation for Personalized Generation with LLMs
- Beyond Isolated Behaviors: Hierarchical User Modeling for LLM Personalization
- Customer-R1: Personalized Simulation of Human Behaviors via RL-based LLM Agent in Online Shopping
- Social-R1: Towards Human-like Social Reasoning in LLMs
- HumanLM: Simulating Users with State Alignment Beats Response Imitation
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems