Evaluating Deception, Not Just Deepfakes
cs.CY
Submitted: 2026-05-09
Updated: 2026-10-28
Comments: Accepted at the NeurIPS 2026 Workshop on Trustworthy AI Evaluation (TAE)
License: http://creativecommons.org/licenses/by/4.0/
The gist: Deepfake detection is typically evaluated as a media-classification task: given a clip, determine whether it is synthetic.
Terminology
Abstract
Deepfake detection is typically evaluated as a media-classification task: given a clip, determine whether it is synthetic. Yet benchmark performance is increasingly invoked to support broader claims about preventing deepfake-enabled deception in video calls, voice calls, and targeted communications. We argue that these claims require evidence across two distinct validity gaps. External validity concerns whether detection performance transfers across generators, processing pipelines, and communication channels. Consequential validity, as used here, concerns whether reliable detection translates into timely intervention and prevention of harmful actions. Even perfect synthetic-origin classification does not guarantee prevention when verification is unavailable, intervention occurs too late, or recipients disregard warnings. We therefore propose a scenario-level evaluation framework that integrates media evidence, interaction-level indicators grounded in speech act theory, conversational pragmatics, and influence principles, and operational outcomes. We define candidate measures of attack prevention, benign pass-through, intervention precision under explicit deployment base rates, and intervention timing. Our position is that deployment-oriented evaluation must measure not only whether synthetic media is detected, but whether deception is prevented without unnecessarily disrupting legitimate interactions. https://jesseeho.github.io/deepfake-deception/
Sources
- Deepfake-Eval-2024: A Multi-Modal In-the-Wild Benchmark of Deepfakes Circulated in 2024
- HunyuanVideo: A Systematic Framework For Large Video Generative Models
- IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models
Related papers
- AI-Mediated Communication Can Steer Collective Opinion
- Epistemic Infrastructures of Science in AI Era Should Rebalance Costs of Generation and Verification
- AI out-persuades expert humans in text-based dialogue
- Evaluating Ambient Clinical Scribes in India: The Need for Multilingual Real-World Clinical Conversation Data
- AI Value Alignment for Evolving Social Norms
- Voting Biases in Decentralized Autonomous Organization (DAO) Governance