BusterX: MLLM-Powered AI-Generated Video Forgery Detection and Explanation

summary

The gist

As generative video models become increasingly realistic, detecting AI-generated videos requires systems that offer both accuracy and interpretability The final sentence is BusterX outperforms…

In short

This research introduces BusterX, an MLLM trained with Reinforcement Learning to detect AI-generated videos and provide explanations. It uses a specialized dataset, GenBuster-200K, and a diagnostic benchmark, GenBuster-Bench. BusterX excels in accuracy across different video domains and maintains strong robustness against real-world social media degradation while generating high-quality forensic rationales.

Key concepts

GenBuster-200K
This is a large, high-quality dataset containing over 200,000 videos created by state-of-the-art AI generators. It is specifically designed to be fair by ensuring balanced distributions of gender and ethnicity, addressing limitations in previous datasets.
GenBuster-Bench
This is a testing framework that evaluates video forgery detection along two axes: domain shifts (testing performance across different eras/sources) and generational shifts. It uses an MLLM-as-a-Judge protocol to assess the quality of the model's generated explanations.
BusterX Training Strategy
BusterX is trained using Reinforcement Learning (RL), treating detection as a visual reasoning task where the model generates its own reasoning chain. It uses DAPO over GRPO and optimizes a reward function that balances format adherence, accuracy, and response length.
Visual Reasoning Task
The core idea is to frame video forgery detection not just as classification but as a step-by-step visual reasoning process. The model's ability to articulate the physical inconsistencies it observes in the frames serves as its primary mechanism for making a forensic decision.

Terminology used across episodes

This episode discusses

The paper

BusterX: MLLM-Powered AI-Generated Video Forgery Detection and Explanation · Read on arXiv

Haiquan Wen, Yiwei He, Zhenglin Huang, Tianxiao Li, Zihan Yu, Xingru Huang, Lu Qi, Baoyuan Wu

University of Liverpool University of Liverpool Nanyang Technological University The Chinese University of Hong Kong Shenzhen Wuhan University Hangzhou Dianzi University

As generative video models become increasingly realistic, detecting AI-generated videos requires systems that offer both accuracy and interpretability. However, applying Multimodal Large Language Models (MLLMs) to video forensics is currently limited by outdated datasets, simplistic evaluation protocols, and a reliance on black-box classification. To address these issues, we introduce a comprehensive dataset, benchmark, and baseline model for video forgery detection. First, we present GenBuster-200K, a fair dataset of over 200,000 high-quality videos sourced from state-of-the-art generators, featuring diverse real-world scenarios. Second, we propose GenBuster-Bench, a diagnostic benchmark spanning three progressive tracks (In-Domain, Out-of-Domain, and In-the-Wild) to evaluate models across domain shifts and generational shifts. Finally, we develop BusterX, a simple MLLM baseline with Reinforcement Learning (RL) training. Instead of direct binary classification, BusterX formulates detection as a visual reasoning task, where the generated reasoning chain serves as detector itself. Experimental results demonstrate that BusterX outperforms several leading MLLMs in both detection accuracy and rationale quality.

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: I'm Tom.

Jane: And I'm Jane, here with Lu, Meng and our in-house large language model, Lalam.

Tom: We're looking at the paper: "BusterX: MLLM-Powered AI-Generated Video Forgery Detection and Explanation".

Jane: Here's the gist of the paper. As generative video models become increasingly realistic, detecting AI-generated videos requires systems that offer both accuracy and interpretability The final sentence is BusterX outperforms several leading MLLMs (e.g., Qwen3.5, Claude-Sonnet-4.6) in both detection accuracy and rationale quality Dataset Introduction The paper introduces GenBuster-200K, a fair dataset of over 200,000 high-quality videos sourced from state-of-the-art generators This dataset is designed to address limitations in prior work by leveraging the latest generators and enforcing rigorous fairness constraints such as balanced gender and ethnicity distributions The construction pipeline involves three stages: Diverse Seed Generation, Description Generation, and Post-filtering Benchmark Design GenBuster-Bench is proposed as a diagnostic benchmark that decomposes the video forgery detection challenge along two critical axes: domain shifts and generational shifts This dual-axis design partitions the evaluation into three progressive tracks: In-Domain (Era: 2024), Out-of-Domain (Era: 2025), and In-the-Wild (Era: 2026) The evaluation protocol includes an MLLM-as-a-Judge protocol to assess the quality of the generated forensic explanations Model Training Strategy BusterX is developed as an MLLM baseline with Reinforcement Learning (RL) training, formulating detection as a visual reasoning task where the generated reasoning chain serves as the detector itself The RL training utilizes DAPO over GRPO because DAPO effectively prevents entropy collapse inherent to standard GRPO The total reward R is a weighted sum of three components: rformat, raccuracy, and rsoft overlong penalty Performance Results Experimental results demonstrate that BusterX outperforms several leading MLLMs (e.g., Qwen3.5, Claude-Sonnet-4.6) in both detection accuracy and rationale quality BusterX achieves the highest overall accuracy among all open-source MLLMs and classical detectors on the In-Domain (ID) track Furthermore, BusterX maintains strong robustness against real-world social media degradations in the Wild track The model’s full responses in Case Study shows that it successfully identifies physical inconsistencies like inconsistent wave progression Explainability Assessment BusterX achieves the highest Wild Rationale score as evaluated by the Gemini Judge on correctly predicted fake samples Human evaluation of the rationales generated by BusterX on the Wild track yielded a mean human score of 78.7, which shows a high level of forensic alignment with automated judges The model's ability to pinpoint subtle spatiotemporal inconsistencies is highlighted as a key capability Future Directions The current framework is limited to the visual modality, leaving audio manipulation and audiovisual semantic inconsistencies unaddressed Future work will extend toward audio-visual multimodal detection A societal impact note acknowledges the dual-use nature of this research and encourages access controls when deploying forensic tools in adversarial settings The paper also notes a scaling law within the Qwen3.5 family, indicating that larger parameter sizes bring consistent benefits in handling highly diverse, real-world forgeries The study concludes by emphasizing that formulating detection as a step-by-step visual reasoning task is essential The authors also detail the prompt design pipeline used to guide the model's response generation The paper references numerous related works in AI-generated video detection methods and MLLMs The paper concludes by addressing critical vulnerabilities in AI-generated video detection through three contributions The authors also provide detailed experimental details regarding training configurations and evaluation parameters for reproducibility The paper includes a section on related work covering early datasets, detection methods, and MLLMs The paper concludes by providing a list of references spanning various foundational and recent works in the field Page 1 --- BusterX: MLLM-Powered AI-Generated Video Forgery Detection and Explanation Forgery Detection and Explanation Haiquan Wen1∗ Yiwei He1∗ Zhenglin Huang1∗ Tianxiao Li1 Zihan Yu1 Xingru Huang5 Lu Qi4 Baoyuan Wu3 Xiangtai Li2 Guangliang Cheng1† Page 2 --- Table 1: Comparison with existing datasets.

Tom: GenBuster outperforms prior works in scale, visual quality and fairness (balanced gender, age, and ethnicity distributions).

Jane: In-the-wild refers to whether the dataset includes videos sourced from social media out-of-domain models or breaks down under real-world social media degradations Crucially, they also ignore the explainability of detection models In forensic scenarios, providing a human-readable rationale is just as important as the binary verdict itself Page 3 --- Lack of Forensic Reasoning: Recent methods that adapt MLLMs for detection either use them as auxiliary to assist binary classification, or merely to generate post-hoc explanations Neither approach treats step-by-step physical and spatiotemporal reasoning as the detection mechanism itself Page 4 --- To address these limitations, we introduce three contributions: 1) GenBuster-200K: A High-Quality and Fair Dataset 2) GenBuster-Bench: A Progressive Diagnostic Benchmark 3) BusterX: A Strong MLLM Baseline with RL Training Page 5 --- In-Domain (ID) Performance and Bias Mitigation.

Tom: On the ID track, BusterX achieves the highest overall accuracy among all open-source MLLMs and classical detectors For instance, Qwen3.5-122B exhibits a conservative bias (79.4% on Real, but 54.7% on Fake) Conversely, Claude-Sonnet-4.6 suffers from an over-forgery bias, which ruins its performance on real videos (61.6% Real ACC) In contrast, BusterX maintains a balanced performance, demonstrating that our training paradigm successfully aligns the model’s forensic perception without compromising its judgment on authentic videos Page 6 --- Out-of-Domain (OOD) Generalization.

Paper summary: Jane: So, to wrap up this discussion on BusterX: MLLM-Powered AI-Generated Video Forgery Detection and Explanation, we have seen how they built a comprehensive system involving a new dataset of over two hundred thousand videos, a progressive benchmark testing domain shifts across three tracks, and their model trained with reinforcement learning to make the detection process itself the reasoning chain.

Lu: What stands out is their focus on creating high-quality forensic explanations, as evidenced by the high Wild Rationale scores and human evaluation scores of seventy-eight point seven <ref:2505.12620#pg2>. This proves that generating a step-by-step visual reasoning task is a powerful way to move beyond simple binary verdicts in video forensics.

Tom: And when we look at the overall performance metrics, BusterX outperforms several leading MLLMs like Qwen3 point 5 and Claude-Sonnet-four point six in both detection accuracy and rationale quality <ref:2505.12620#pg1> <ref:2505.12620#pg1>. This suggests that their training paradigm, using DAPO over GRPO with a weighted reward function including accuracy and a soft overlong penalty, is effectively aligning the model's forensic perception without hurting its judgment on real videos.

Meng: The big picture for deployment is that while this work shows strong robustness against real-world social media degradations in the Wild track, it’s not yet ready for full audio-visual detection because they haven't tackled those other modalities yet <ref:2505.12620#pg1>. It’s a solid visual reasoning foundation, though.

Jane: So, the authors of BusterX are essentially showing that by treating detection as a visual reasoning task guided by careful dataset construction and reinforcement learning training, we can build systems that are both highly accurate at detecting fakes and provide detailed explanations for those detections <ref:2505.12620#pg1>. That’s what this paper is all about.

Conclusion: Tom: So we're wrapping up this look at BusterX, and it’s really worth focusing on what that title says: "BusterX: MLLM-Powered AI-Generated Video Forgery Detection and Explanation."

Jane: I think that title tells you exactly what the paper is about. It’s not just saying it finds fakes; it’s claiming to do both detection and explanation, which is a big deal in this field.

Lu: Exactly. The core idea here isn't just getting a yes or no on whether a video is fake. They are building a system where the model’s reasoning chain *is* the detector itself, so you get that explanation along with the verdict.

Meng: But how does that actually work without making things too slow? I mean, if we have to generate this whole step-by-step reasoning for every single video, what’s the computational cost when we try to deploy this at scale?

Tom: That’s where the training strategy comes in. They used reinforcement learning with something called DAPO over GRPO. It sounds complicated, but basically, they trained the model by rewarding it for doing things right—for being accurate and for not giving overly long, useless answers.

Jane: And those results are really compelling because BusterX beat some of the biggest models out there on both finding fakes and giving good explanations.

Lu: It's interesting because they showed that this approach works well across different challenges, like videos from the same time period versus real-world social media messiness. They found it maintains strong performance even when things get degraded in the wild.

Meng: Robustness is one thing, but accuracy on the hardest data is another. If we’re talking about what this means for production, can we rely on this kind of reasoning chain to catch subtle things that generic models miss?

Tom: The scaling law they mentioned with Qwen3 point five suggests that bigger parameter sizes bring consistent benefits when dealing with really diverse fakes, which is good news for future hardware planning <ref:2505.12620#pg1>.

Jane: So, BusterX shows us a direction where the model doesn't just guess; it thinks its way through the visual details to find the inconsistency and then explains exactly why it flagged it.

Lu: And that emphasis on step-by-step reasoning is crucial because it’s what makes the detection method itself more transparent and trustworthy.

Meng: For me, the next big question is whether this deep reasoning structure can be adapted to handle audio too, since they only focused on the visual side for now.

Tom: That's definitely a future direction they flagged—audio-visual detection is next on the list for them.

More episodes

← Home