The Verification Crisis: Expert Perceptions of GenAI Disinformation and the Case for Reproducible Provenance
cs.CY, cs.AI, cs.SI
Submitted: 2026-02-02
Updated: 2026-10-29
Comments: 9 pages. Author version; the Version of Record appeared in the Companion Proceedings of the ACM Web Conference 2026 (WWW '26 Companion), pp. 980-988
Journal ref: Companion Proceedings of the ACM Web Conference 2026 (WWW '26 Companion), pp. 980-988
Code: https://github.com/aloth/verificationcrisis
License: http://creativecommons.org/licenses/by/4.0/
The gist: The growth of Generative Artificial Intelligence (GenAI) has shifted disinformation production from manual fabrication to automated, large-scale manipulation.
Terminology
Abstract
The growth of Generative Artificial Intelligence (GenAI) has shifted disinformation production from manual fabrication to automated, large-scale manipulation. This article presents findings from the first wave of a longitudinal expert perception survey (N=21) involving AI researchers, policymakers, and disinformation specialists. It examines the perceived severity of multimodal threats -- text, image, audio, and video -- and evaluates current mitigation strategies. Results indicate that while deepfake video presents immediate "shock" value, large-scale text generation poses a systemic risk of "epistemic fragmentation" and "synthetic consensus," particularly in the political domain. The survey reveals skepticism about technical detection tools, with experts favoring provenance standards and regulatory frameworks despite implementation barriers. GenAI disinformation research requires reproducible methods. The current challenge is measurement: without standardized benchmarks and reproducibility checklists, tracking or countering synthetic media remains difficult. We propose treating information integrity as an infrastructure with rigor in data provenance and methodological reproducibility.
Sources
- Adversarial Attacks on AI-Generated Text Detection Models: A Token Probability-Based Approach Using Embeddings
- Blessing or curse? A survey on the Impact of Generative AI on Fake News
- Eroding the Truth-Default: A Causal Analysis of Human Susceptibility to Foundation Model Hallucinations and Disinformation in the Wild
- Industrialized Deception: The Collateral Effects of LLM-Generated Misinformation on Digital Ecosystems
- A Cost Analysis of Generative Language Models and Influence Operations
- Facts are Harder Than Opinions -- A Multilingual, Comparative Analysis of LLM-Based Fact-Checking Reliability
Related papers
- AI-Mediated Communication Can Steer Collective Opinion
- Epistemic Infrastructures of Science in AI Era Should Rebalance Costs of Generation and Verification
- AI out-persuades expert humans in text-based dialogue
- Evaluating Ambient Clinical Scribes in India: The Need for Multilingual Real-World Clinical Conversation Data
- AI Value Alignment for Evolving Social Norms
- Voting Biases in Decentralized Autonomous Organization (DAO) Governance