Stop My Dancing! Understanding, Detecting and Attributing Motion-Aware Deepfake Videos
cs.CV, cs.CR
Submitted: 2026-10-08
Updated: 2026-10-12
License: http://creativecommons.org/licenses/by/4.0/
The gist: Pose-guided diffusion models can now synthesize entire human figures in motion, spawning a new class of deepfakes: Motion Aware Deepfake (MAD) that have already reached hundreds of millions of
Terminology
Abstract
Pose-guided diffusion models can now synthesize entire human figures in motion, spawning a new class of deepfakes: Motion Aware Deepfake (MAD) that have already reached hundreds of millions of viewers. To better understand this emerging threat, we construct the first MAD-specific benchmark and measurement framework, containing over 1.5 million frames that mix 1,363 real and 30,122 synthetic videos from six controllable generators, with realistic perturbations and open-world evaluation splits. Then, we dissect MAD and discover that, despite their global coherence, these videos betray faint yet reliable cues: because the model relies on limited input frames for motion synthesis, it must predict and simulate coherent movement at motion boundaries, thereby producing high-frequency artifacts along with model-specific spectral fingerprints. Based on the observations obtained from analysis on dataset, we propose MoDA, the first defense framework tailored to detect and attribute MAD videos. MoDA couples spatial semantics with steganalysis-rich frequency features via cross-domain alignment and multi-scale aggregation, achieving 94.8% in-distribution and 89.1% cross-dataset detection accuracy gains of 10% to 25% over prior work and 91.5% model attribution accuracy. MoDA achieves 81.94% accuracy on 200 clips produced by two unseen commercial MAD platforms, indicating promising zero-shot transfer, and 78.13% detection accuracy on 1,200 unseen MAD video clips (55k frames in total) collected from the open Internet. Under white-box, gray-box, and black-box adaptive attacks, MoDA maintains relatively stable detection and attribution performance while the accuracies of the baselines drop rapidly.
Sources
- Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets
- StyleGAN-Human: A Data-Centric Odyssey of Human Generation
- AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning
- Benchmarking Neural Network Robustness to Common Corruptions and Perturbations
- Adam: A Method for Stochastic Optimization
- Regeneration Based Training-free Attribution of Fake Images Generated by Text-to-Image Generative Models
- Towards Deep Learning Models Resistant to Adversarial Attacks
- Deepfake Generation and Detection: A Benchmark and Survey
- Towards the Detection of Diffusion Model Deepfakes
- Frequency-Aware Deepfake Detection: Improving Generalizability through Frequency Space Learning
- Wan: Open and Advanced Large-Scale Video Generative Models
- DisCo: Disentangled Control for Realistic Human Dance Generation
- A Sanity Check for AI-generated Image Detection
- MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidance
- PatchCraft: Exploring Texture Patch for Efficient AI-generated Image Detection
- Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models