DeepfakeBench-MM: A Comprehensive Benchmark for Multimodal Deepfake Detection

summary

The gist

DeepfakeBench-MM introduces Mega-MMDF, a large-scale and diverse multimodal deepfake dataset and DeepfakeBench-MM…

In short

DeepfakeBench-MM introduces Mega-MMDF, a large, diverse multimodal deepfake dataset with 1.2 million samples, and DeepfakeBench-MM, a unified benchmark for multimodal deepfake detection. This infrastructure standardizes training and evaluation across five datasets and eleven detectors to facilitate deeper research into forgery detection.

Key concepts

Mega-MMDF
A massive, high-quality dataset containing 1.2 million real and forged samples. It was created using an automated framework that generated 21 compositionally diverse forgery pipelines based on various methods and types, ensuring large scale and high diversity.
DeepfakeBench-MM
The first unified benchmark for multimodal deepfake detection. It supports five different multimodal datasets and eleven distinct detectors within an extensible codebase. It standardizes protocols for training and evaluation, allowing for fair comparisons across different methods.
Multimodal Deepfake Detection
The field of detecting manipulated media that combines visual (video) and auditory (audio) elements. This paper focuses on creating tools and benchmarks to accurately identify deepfakes where both the video content and the accompanying sound are intentionally forged or manipulated.
Modality Competition
A phenomenon observed in single-modality detectors where they show a consistent bias toward the visual modality. This suggests that late-fusion architectures might lead to competition between modalities rather than complementary information when detecting deepfakes.

Terminology used across episodes

This episode discusses

The paper

DeepfakeBench-MM: A Comprehensive Benchmark for Multimodal Deepfake Detection · Read on arXiv

The Chinese University of Hong Kong, Shenzhen · University at Buffalo, State University of New York · Nanjing University of Posts and Telecommunications

Audio-visual deepfakes can spread misinformation and enable impersonation, undermining trust in digital media. However, existing datasets provide limited coverage of forgery operations and their combinations, constraining detector development and systematic evaluation. We introduce Mega-MMDF, containing 100,000 real and 1.2 million forged clips across 22 pipelines spanning modality-specific manipulations, stacked forgeries, and joint audio-video generation. To assess its training value and enable fair comparisons, we develop DeepfakeBench-MM, which standardizes training and evaluation across 8 datasets and 10 detectors. Training-based detectors achieve their highest mean AUC when trained on Mega-MMDF, with gains of up to 0.0784 over the best alternative training dataset for each detector. Experiments on data scale and pipeline coverage further support the value of large, diverse training data. Cross-pipeline evaluations reveal bidirectional and asymmetric generalization. Training on composite forgeries does not necessarily enable detection of their constituent operations in isolation. Our analysis of altered inputs shows that modality masking can increase false alarms and missed detections, and temporal misalignment can raise mean predicted forgery probabilities. Together, these resources provide a foundation for understanding and improving multimodal deepfake detection, with publicly available code and dataset access subject to application and usage terms.

Transcript

Introduction to the show: ident: Security Radio. Generated commentary on the latest security and cryptography papers.

Nadia: We're looking at the paper: "DeepfakeBench-MM: A Comprehensive Benchmark for Multimodal Deepfake Detection".

Elias: Here's the gist of the paper. DeepfakeBench-MM introduces Mega-MMDF, a large-scale and diverse multimodal deepfake dataset and DeepfakeBench-MM, the first unified benchmark for multimodal deepfake detection The paper presents this infrastructure to address the lack of sufficient and diverse training data and standardized benchmarks hindering deeper exploration Dataset Construction Mega-MMDF is a large-scale multimodal deepfake dataset constructed through an automated deepfake generation framework, featuring three key characteristics: large scale, high forgery diversity, and high quality The dataset contains 0.1 million real samples and 1.1 million forged samples, totaling 1.2 million instances The construction involves generating 21 compositionally diverse forgery pipelines based on combinations of 28 forgery methods across 7 forgery types Quality control is integrated into every pipeline through three assessment modules: audio quality assessment, visual quality assessment, and audio-video synchronization quality assessment Overall dataset quality was validated using objective quantitative metrics like Fréchet Audio Distance (FAD) and Fréchet Video Distance (FVD), alongside human studies involving 60 volunteers Benchmark Development DeepfakeBench-MM is the first unified benchmark for multimodal deepfake detection, supporting 5 multimodal deepfake datasets and 11 detectors within an extensible codebase The benchmark standardizes training/evaluation protocols across detection components and provides a common platform for method analysis Supported datasets include FakeAVCeleb, LAV-DF, AVDeepfake1M, IDForge, and Mega-MMDF Detectors implemented span four categories: Baseline Models, Regular Models (7 detectors), Ensemble Models (one model), and Pretrained Multimodal Large Language Models (two models) The evaluation protocol focuses on intra-dataset performance, cross-dataset generalization, and cross-pipeline generalization using the AUC metric Analysis of Findings Analysis 1 observed that although detectors generally achieve high AUCs within Mega-MMDF (up to 0.994), their performance drops markedly when applied to external datasets Analysis 2 revealed that in stacked forgeries, artifacts contribute unequally, following the hierarchy EFS > FS > FR Analysis 3 showed that finetuning the second-stage backbones of detectors like AVTS and AVFF yields consistent improvements across datasets Analysis 4 indicated a consistent bias toward the visual modality when detectors operate in a single-modality scenario, suggesting that late-fusion architectures often lead to modality competition rather than complementarity Future Directions The key takeaway messages suggest that current multimodal detectors rely more on visual artifacts and need new architectures and fusion strategies to mitigate modality bias Future work should explore finetuning the second-stage backbones or randomly masking the dominant modality during training to achieve more balanced results Mitigating artifact bias in visual modalities is key to learning richer and more diverse forgery cues The paper concludes that Mega-MMDF and DeepfakeBench-MM provide a solid foundation for future research in multimodal deepfake detection In this work, the authors first introduce Mega-MMDF, a million-scale, diverse, and high-quality dataset designed to advance research in multimodal deepfake detection Building upon it, they develop DeepfakeBench-MM, the first unified benchmark that standardizes preprocessing and evaluation protocols for multimodal deepfake detection Leveraging these infrastructures allows for fair comparisons and facilitates the development of new methods The release of Mega-MMDF and DeepfakeBench-MM is believed to provide a solid foundation for future research in this area References Enes Altuncu, Virginia NL Franqueira, and Shujun Li.

Nadia: Deepfake: Definitions, performance metrics and standards, datasets, and a meta-review.

Elias: Frontiers in Big Data, 2024 Junyi Ao et al.

Nadia: Speecht5: Unified-modal encoder-decoder pre-training for spoken language processing.

Paper summary: Nadia: It’s about providing the infrastructure needed so we can actually compare different detection methods fairly against one another, which is a big step forward for how we approach defense against deepfakes in practice.

Elias: The authors are addressing the lack of sufficient and diverse training data, and they've built a comprehensive benchmark that tackles both data scarcity and evaluation standardization at once.

Priya: From my side, I think the real value here is moving away from detectors that only work well on one specific type of forgery artifact toward systems that can handle the full spectrum of multimodal fakes we see in the wild.

Nadia: Yeah, so we have this massive dataset and a standardized testbed to push the limits on what multimodal deepfake detection can actually achieve when it has to deal with real-world complexity.

Conclusion: Nadia: So we’ve seen how they built this huge set of real and fake data, and now they have a way to test all these different detectors against it all at once.

Elias: They call it DeepfakeBench-MM, and honestly, the authors are focused on making sure everyone is using the same rules for training and testing these detection models.

Priya: What I see here is that by standardizing the setup, they’re trying to get past just seeing if one detector works well on one dataset.

Nadia: Right, so instead of just saying a model got a high score on Mega-MMDF and then hoping it works elsewhere, they are testing how well it generalizes across different kinds of fakes and even different types of data.

Elias: They’ve included five different deepfake datasets and eleven detectors to see if those models can actually handle the variety.

Priya: That standardization is important because it forces us to look at where those models fail, not just where they succeed on a neat little test set.

Nadia: It really comes down to whether these tools are robust enough for real-world use against the messy stuff people are actually making now.

Elias: The authors have built a solid foundation here, and it gives us a common place to start looking at how well our detection strategies hold up under pressure.

Priya: And looking at the findings, they point out that there’s still this bias towards visual details in some single-modality setups, which tells us we need better ways to balance what the system is actually paying attention to.

Nadia: Yeah, so it suggests that future work needs to focus on making those models less reliant on just the visual stuff when they are dealing with audio too.

Elias: Exactly, and that’s where we go next because understanding this limitation tells us exactly where we need to push our research in the next few years.

More episodes

← Home