ROAM-ASD: Robust Open-World Active Speaker Detection with Flexible Multimodal Fusion

arXiv:2609.26648 · cs.MM, cs.CV, cs.SD, eess.AS, eess.IV · Submitted 2026-09-22 · Read on arXiv

cs.MM, cs.CV, cs.SD, eess.AS, eess.IV

Submitted: 2026-09-22

Updated: 2026-09-24

Comments: Submitted to IEEE ICASSP 2027

Project page: https://wangpuup.github.io/ROAM-ASD

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Benchmark — 14× in this paper · explained in 2 episodes
• Robustness — 7× in this paper · explained in 5 episodes
• Generalization — 5× in this paper · explained in 13 episodes
• Adaptation — 3× in this paper · explained in 1 episode
• Transformer — 3× in this paper · explained in 2 episodes
• Computer Vision and Pattern Recognition — 2× in this paper
• Multimodal Fusion — 2× in this paper · explained in 3 episodes
• Attention Mechanism — 1× in this paper · explained in 2 episodes
• CVF International Conference on Computer Vision — 1× in this paper
• Contrastive Learning — 1× in this paper · explained in 5 episodes
• Data Augmentation — 1× in this paper · explained in 7 episodes
• Embeddings — 1× in this paper · explained in 2 episodes
• Face Occlusion — 1× in this paper
• International Conference on Learning Representations — 1× in this paper
• Multimodal Learning — 1× in this paper · explained in 2 episodes
• Optimal Conditions — 1× in this paper
• Speech Impairment — 1× in this paper
• Surveillance Settings — 1× in this paper

Sources

• MUSAN: A Music, Speech, and Noise Corpus

Related papers

• ControlFoley: Unified and Controllable Video-to-Audio Generation with Cross-Modal Conflict Handling
• Mechanisms of Multimodal Synchronization: Insights from Decoder-Based Video-Text-to-Speech Synthesis
• Zero-shot Video Moment Retrieval via Off-the-shelf Multimodal Large Language Models
• Mitigating GenAI-powered Evidence Pollution for Out-of-Context Multimodal Misinformation Detection
• A Rate-Distortion-Classification Approach for Lossy Image Compression