LLM-as-a-Demographic: Whom Sociodemographic Prompting Helps, and Whom It Hurts
The discussion of 'LLM-as-a-Demographic' explores how conditioning a large language model (LLM) reflects social reality and biases. The hosts analyze research showing that demographic prompting influences model judgment, confirming these effects are intrinsic to the AI's reasoning rather than statistical noise. They conclude that prompt design is an ethical necessity to manage unintended consequences.