AI Agents are Vulnerable to Radicalization
cs.AI, cs.CY
Submitted: 2026-09-29
Updated: 2026-09-29
Project page: https://gssdataexplorer.norc.org
License: http://creativecommons.org/licenses/by/4.0/
The gist: Large language models (LLMs) can influence people's beliefs, yet little is known about whether and how they can manipulate each other.
Terminology
Abstract
Large language models (LLMs) can influence people's beliefs, yet little is known about whether and how they can manipulate each other. To investigate this, we simulate conversations between two agents: a target LLM that role-plays a human persona based on demographic and psychological attributes, and an influencer LLM that aims to make the target's beliefs more extreme. We examine radicalization along two pathways: resonance, where the influencer reinforces a target's pre-existing belief, and persuasion, where the influencer promotes a belief the target initially considers unimportant. Across affective and behavioral metrics, we find that both mechanisms radicalize the target. However, resonance produces consistently stronger effects than persuasion. Different influence tactics, such as using sycophancy and unverified claims, produce different levels of radicalization, but not consistently across metrics. We further show that resonance propagates to related beliefs, suggesting interconnected belief structures within AI agents. These findings indicate that AI agents are susceptible to radicalization, particularly when messages align with their existing beliefs, raising concerns about the vulnerability of personalized AI agents and multi-agent AI ecosystems.
Sources
- Large language models can effectively convince people to believe conspiracies
- Deceptive AI systems that give explanations are more convincing than honest AI systems and can amplify belief in misinformation
- "Humans welcome to observe": A First Look at the Agent Social Network Moltbook
- Governing AI Agents
- Towards Understanding Sycophancy in Language Models
- Believe It or Not: How Deeply do LLMs Believe Implanted Facts?
- OASIS: Open Agent Social Interaction Simulations with One Million Agents
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems