Have I Seen Enough? Frozen Video-Language Models Encode Evidence Readiness
cs.CV, cs.CL, cs.LG
Submitted: 2026-10-06
Updated: 2026-10-08
License: http://creativecommons.org/licenses/by/4.0/
The gist: Streaming video-language models must decide not only what to answer, but whether the evidence needed for the current question has arrived.
Abstract
Streaming video-language models must decide not only what to answer, but whether the evidence needed for the current question has arrived. Existing systems learn that decision as a separate trigger; we ask whether an unmodified model already computes it. We show that frozen VideoLLMs carry a linearly readable evidence-readiness signal, labelled from timestamped evidence rather than from model output. It decodes in all seven models of a shared byte-identical evaluation (AUROC 0.733-0.905 under the strictest not-ready sampling, where a fitted clock is near chance), and a probe fitted without any of a benchmark family's footage still reads that family. It is question-conditioned: on byte-identical windows, changing only the question reverses the readout on 66.1% of pairs, while every question-blind control is at chance by construction. The model can answer incorrectly and still encode readiness: AUROC remains 0.722 among wrong answers. Readiness also beats uncertainty estimators and their supervised combination on latency-matched answer selection, and tracks independent human judgments more closely than confidence. Released streaming triggers are also linear readouts, yet a trained trigger read on its own base model's activations is approximately orthogonal to readiness and decodes it far less accurately than a probe. We turn the readout into Readiness Gating, an answer-timing policy that improves accuracy by up to +9.75 pp at matched video duration with negligible computational overhead. How much it gains varies with the accuracy headroom the task makes available: across 26 configurations the gain tracks that headroom, and an intervention that moves it over identical pixels moves the gain with it.
Sources
- Pixtral 12B
- LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Training
- Regularized Learning for Domain Adaptation under Label Shifts
- HiMu: Hierarchical Multimodal Frame Selection for Long Video Question Answering
- Grounded Question-Answering in Long Egocentric Videos
- GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning
- Bridging the Detection-to-Abstention Gap in Reasoning Models under Insufficient Information
- Multi-Scale Dense Networks for Resource Efficient Image Classification
- Language Models (Mostly) Know What They Know
- Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generation
- Building and better understanding vision-language models: insights and future directions
- Accuracy Without Grounding: Diagnosing Visual Dependency Dissociation in Video LLM Benchmarks
- StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understanding
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- Qwen3-VL Technical Report
- Pathways of Visual Information Flow in Vision-Language Models
- Two Axes of LLM Abstention: Answer Correctness and Question Answerability
- Tent: Fully Test-time Adaptation by Entropy Minimization
- Evidence-Backed Video Question Answering
- InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models