Not Another Text Benchmark: Putting the "Visual" Back in Visual Question Answering for Large Video Models
The authors created three new visual evaluation benchmarks for large video models: temporal frame retrieval, video future prediction, and causal memory distortion. These tasks test if models can reason visually rather than just through text prompts. Results show current frontier models struggle with fine-grained visual temporal understanding.