SleuthVLM: Do We Really Need Audio-in-Video for Omni Video Understanding?
cs.CV
Submitted: 2026-11-04
Updated: 2026-11-04
Code: https://github.com/WPR001/OpenOmniHarness
Project page: https://wpr001.github.io/sleuthVLM
Terminology
Sources
- Qwen Technical Report
- Sandboxed Coding Agents are Competitive Omni-modal Task Solvers
- MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interaction
- Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligence
- video-SALMONN-R$^3$: Learning to ReWatch, ReAsk, and ReAnswer for Efficient Video Understanding
- Omni-Decision: Evidence-Ledger Planning for Omni-Modal Agents
- Video-Index: A Curated Meta-Benchmark for Video Understanding
- video-SALMONN 2: Caption-Enhanced Audio-Visual Large Language Models
- Active Perception Agent for Omnimodal Audio-Video Understanding
- LVOmniBench: Pioneering Long Audio-Video Understanding Evaluation for Omnimodal LLMs
- LongCat-Flash-Omni Technical Report
- Qwen3.8-Omni: Towards Native Omni-Modal Agents
- Qwen3.5-Omni Technical Report
- InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency
- UGC-VideoCaptioner: An Omni UGC Video Detail Caption Model and New Benchmarks
- Mini-Omni2: Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities
- Native Active Perception as Reasoning for Omni-Modal Understanding
- Qwen2.5-Omni Technical Report
- Qwen3-Omni Technical Report
Related papers
- TEA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models
- Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
- Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment
- PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
- DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- Out of Sight, Still in Mind: Token Compression for Omni-LLMs