Human-AI Interactions and Societal Pitfalls
cs.AI, cs.HC, econ.GN, q-fin.EC
Submitted: 2023-09-19
Updated: 2026-11-18
License: http://creativecommons.org/licenses/by/4.0/
The gist: When working with generative artificial intelligence (AI), users may see productivity gains, but the AI-generated content may not match their preferences exactly.
Terminology
Abstract
When working with generative artificial intelligence (AI), users may see productivity gains, but the AI-generated content may not match their preferences exactly. To study this effect, we introduce a Bayesian framework in which heterogeneous users choose how much information to share with the AI, facing a trade-off between output fidelity and communication cost. We show that the interplay between these individual-level decisions and AI training may lead to societal challenges. Outputs may become more homogenized, especially when the AI is trained on AI-generated content, potentially triggering a homogenization death spiral. And any AI bias may propagate to become societal bias. A solution to the homogenization and bias issues is to reduce human-AI interaction frictions and enable users to flexibly share information, leading to personalized outputs without sacrificing productivity.
Sources
- Homogenization Effects of Large Language Models on Human Creative Ideation
- Improving Human Sequential Decision-Making with Reinforcement Learning
- Algorithmic Decision-Making Safeguarded by Human Knowledge
- GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models
- The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientation
- The Curse of Recursion: Training on Generated Data Makes Models Forget
- Fine-Tuning Language Models from Human Preferences
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents