Stochastic Parrots or Singing in Harmony? Testing Five Leading LLMs for their Ability to Replicate a Human Survey with Synthetic Data
cs.CY, cs.AI
Submitted: 2026-02-10
Updated: 2026-10-01
Terminology
Sources
- AI-Assisted Variance Reduction in Randomized Experiments
- This human study did not involve human subjects: Validating LLM simulations as behavioral evidence
- Evaluating the Use of Large Language Models as Synthetic Social Agents in Social Science Research
- Synthetic Data Generation Using Large Language Models: Advances in Text and Code
- Meaning without reference in large language models
Related papers
- Reasoning Enhances Robustness to Prompt Injection in LLM-Based Consensus
- Generative AI Purpose-built for Social and Mental Health: A Real-World Pilot
- PersonaMem-v3: Toward Omni-Platform Personal Intelligence for Holistic User Understanding, Recommendation, and Agentic Tasks
- What is an intelligent system?
- AI University: An LLM-Powered Learning Assistant for Engineering---A Finite Element Method Case Study
- Generative AI Use in Entrepreneurship: An Integrative Review and an Empowerment-Entrapment Framework