Joint Workflow and Prompt Optimization for User Behavior Simulation
cs.MA, cs.AI, cs.LG
Submitted: 2026-10-06
Updated: 2026-10-06
Comments: under review for ACM Transactions on Information Systems Journal, 34 pages, 2 figures
Code: https://github.com/cruiseresearchgroup/SOCIA
License: http://creativecommons.org/licenses/by/4.0/
The gist: User behavior simulation is the computational modeling of user interactions within information systems through the use of simulated agents in place of live users.
Abstract
User behavior simulation is the computational modeling of user interactions within information systems through the use of simulated agents in place of live users. It supports system testing and evaluation, decision-making and forecasting, and user experience design. Existing simulators rely on hand-crafted rules or domain expertise that transfers poorly across tasks. SWORD (Simulation-driven Workflow and Prompt Optimization with Role-based Design) is introduced as a framework that jointly optimizes multi-agent workflow topology and natural-language prompts. It is guided solely by a scalar task metric, without domain initialization or task-specific engineering. The experimental results demonstrate that SWORD achieves statistically significant gains over prompt-only, workflow-only, and staged-optimization baselines under a controlled, identical-backbone comparison. Against the strongest published domain-specific baseline, SWORD further improves accuracy while using a smaller backbone model, substantially less training data, and a very reasonable API cost (4-- 6 for each dataset). Beyond predictive performance, SWORD autonomously discovers domain-relevant signals, review-sentiment mapping rules and epidemiological decay priors, purely from scalar error feedback, establishing textual gradients as a mechanism for unsupervised feature-importance discovery in user behavior modeling.
Sources
- RePrompt: Planning by Automatic Prompt Engineering for Large Language Models Agents
- Introducing MAPO: Momentum-Aided Gradient Descent Prompt Optimization
- Stabilizing Black-Box Prompt Optimization with Textual Regularization and Signal Aggregation
- Universal Masking is Urgent in the COVID-19 Pandemic: SEIR and Agent Based Models, Empirical Validation, Policy Recommendations
- From Novice to Expert: LLM Agent Policy Optimization via Step-wise Reinforcement Learning
- MASPOB: Bandit-Based Prompt Optimization for Multi-Agent Systems with Graph Neural Networks
- Do LLMs Understand User Preferences? Evaluating LLMs On User Rating Prediction
- AutoFlow: Automated Workflow Generation for Large Language Model Agents
- SEW: Self-Evolving Agentic Workflows for Automated Code Generation
- BESSIE: A Behavior and Epidemic Simulator for Use With Synthetic Populations
- AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Society
- From the Fluency Fallacy to the Micro-to-Macro Validity Gap: Opportunities and Pitfalls of LLMs in Social Simulation
- ScoreFlow: Mastering LLM Agent Workflows via Score-based Preference Optimization
- MASPO: Joint Prompt Optimization for LLM-based Multi-Agent Systems
- Rethinking the Value of Multi-Agent Workflow: A Strong Single Agent Baseline
- The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search
- LLM-AutoDiff: Auto-Differentiate Any LLM Workflow
- EvoFlow: Evolving Diverse Agentic Workflows On The Fly
- SocioVerse: A World Model for Social Simulation Powered by LLM Agents and A Pool of 10 Million Real-World Users
Related papers
- Highway Congestion Reduction through Reinforcement Learning Based Eulerian Headway Control
- ORACLE-SWE: Quantifying the Contribution of Critical Information Signals on SWE Agents
- You Only Align Once: Propagating Cooperative Behaviors in Multi-Agent Systems through Seed Agents
- Deny Without Disabling: Authorization-Paired Evaluation and Control for Multi-Agent Systems
- MA-SAPO: Multi-Agent Reasoning for Score-Aware Prompt Optimization
- PeroMAS: A Multi-agent System of Perovskite Material Discovery