A Systematic Study of Cross-Modal Typographic Attacks on Audio-Visual Reasoning
This study investigates 'Multi-Modal Typography,' where injecting synthesized speech into videos attacks audio-visual models. The research found that coordinated attacks across audio and visual streams are significantly more potent than single-modality attacks, showing MLLMs are highly vulnerable to manipulated spoken cues in reasoning tasks.