When LLMs Manipulate: Measuring Behavioral, Social, and Temporal Effects

arXiv:2610.27573 · cs.AI, cs.CL, cs.CY, cs.HC, cs.LG · Submitted 2026-10-20 · Read on arXiv

cs.AI, cs.CL, cs.CY, cs.HC, cs.LG

Submitted: 2026-10-20

Updated: 2026-10-20

License: http://creativecommons.org/licenses/by/4.0/

The gist: Large language models (LLMs) can influence user trust and decision-making through subtle linguistic cues, yet the behavioral effects of manipulative outputs remain poorly quantified.

Abstract

Large language models (LLMs) can influence user trust and decision-making through subtle linguistic cues, yet the behavioral effects of manipulative outputs remain poorly quantified. We introduce a behavioral computing framework for measuring behavioral vulnerability, defined as users' susceptibility to manipulative AI responses. Building on DarkPatterns-LLM benchmark, we generate controlled manipulative stimuli using Manipulation Gradient Descent (MGD), targeting biases associated with authority, urgency, and social proof. We analyze participant responses using the Multi-Stakeholder Impact Assessment Network (MSIAN) to model cross-user influence and the Temporal Harm Propagation Model (THPM) to characterize the persistence of behavioral effects over time. In a study involving 120 participants, manipulative framing produced significant changes in trust calibration and compliance (p < 0.01), with effects also propagating across social contexts. These findings highlight the need to extend LLM safety evaluation beyond model outputs to measurable behavioral consequences and provide a computational framework for quantifying individual, social, and temporal risks arising from manipulative AI interactions.

Related papers