The Synthetic Media Shift: Tracking the Rise, Virality, and Detectability of AI-Generated Multimodal Misinformation
cs.CR, cs.AI, cs.MM
Submitted: 2026-04-15
Updated: 2026-04-15
Journal ref: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2026, pp. 8626-8635
Code: https://github.com/zachos99/convex-dataset
License: http://creativecommons.org/licenses/by-sa/4.0/
The gist: As generative AI advances, the distinction between authentic and synthetic media is increasingly blurred, challenging the integrity of online information.
Terminology
Abstract
As generative AI advances, the distinction between authentic and synthetic media is increasingly blurred, challenging the integrity of online information. In this study, we present CONVEX, a large-scale dataset of multimodal misinformation involving miscaptioned, edited, and AI-generated visual content, comprising over 150K multimodal posts with associated notes and engagement metrics from X's Community Notes. We analyze how multimodal misinformation evolves in terms of virality, engagement, and consensus dynamics, with a focus on synthetic media. Our results show that while AI-generated content achieves disproportionate virality, its spread is driven primarily by passive engagement rather than active discourse. Despite slower initial reporting, AI-generated content reaches community consensus more quickly once flagged. Moreover, our evaluation of specialized detectors and vision-language models reveals a consistent decline in performance over time in distinguishing synthetic from authentic images as generative models evolve. These findings highlight the need for continuous monitoring and adaptive strategies in the rapidly evolving digital information environment.
Sources
- Community Moderation and the New Epistemology of Fact Checking on Social Media
- AMMeBa: A Large-Scale Survey and Dataset of Media-Based Misinformation In-The-Wild
- Scaling Human Judgment in Community Notes with LLMs
- Detecting Multimedia Generated by Large AI Models: A Survey
- From Birdwatch to Community Notes, from Twitter to X: four years of community-based content moderation
- Timeliness, Consensus, and Composition of the Crowd: Community Notes on X
- Birdwatch: Crowd Wisdom and Bridging Algorithms can Inform Understanding and Reduce the Spread of Misinformation
Related papers
- SoK: AI-Augmented Binary Reversing
- Relaxed Sender Anonymity for CBDC Interbank Settlement: A Zero-Knowledge Approach on Permissioned EVM
- Calibration-Family Overfit: Why Trusted Sabotage Monitors Don't Transfer Across Lineages
- Efficient Fuzzy PSI under One-Sided Assumptions
- Sealing the Audit-Runtime Gap for LLM Skills
- Token Composition: A Graph Based on EVM Logs