Where is the multimodal goal post? On the Ability of Foundation Models to Recognize Highlights in Videos

arXiv:2601.16333 · cs.CV, cs.AI, cs.CL · Submitted 2026-01-22 · Read on arXiv

cs.CV, cs.AI, cs.CL

Submitted: 2026-01-22

Updated: 2026-10-13

Terminology

• Foundation Model — 2× in this paper · explained in 3 episodes
• Foundation Models — 2× in this paper · explained in 7 episodes
• Modular Architecture — 1× in this paper · explained in 4 episodes

Sources

• Qwen3-VL Technical Report
• Qwen2.5-VL Technical Report
• Qwen2-Audio Technical Report
• The Llama 3 Herd of Models
• Voxtral
• Qwen2.5 Technical Report
• Automated Detection of Sport Highlights from Audio and Video Sources
• Going for GOAL: A Resource for Grounded Football Commentaries
• Natural Language Generation from Visual Events: State-of-the-Art and Key Open Questions
• Order Matters: Exploring Order Sensitivity in Multimodal Large Language Models
• Qwen2.5-Omni Technical Report
• Qwen3-Omni Technical Report
• Qwen3 Technical Report

Related papers

• Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
• AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
• Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
• MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
• TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
• A Survey on Efficient Vision-Language-Action Models