Beneath the Scores: Rethinking Hallucination Evaluation for Video Understanding Models

arXiv:2609.28991 · cs.CV, cs.AI · Submitted 2026-09-24 · Read on arXiv

cs.CV, cs.AI

Submitted: 2026-09-24

Updated: 2026-09-24

Comments: Accepted in NeurIPS 2026 TAE workshop

License: http://creativecommons.org/licenses/by/4.0/

The gist: Video understanding is increasingly performed by multi-stage LLM agents that separate temporal grounding, visual observation, and reasoning.

Terminology

Abstract

Video understanding is increasingly performed by multi-stage LLM agents that separate temporal grounding, visual observation, and reasoning. Yet these stages are typically evaluated on different benchmarks and distributions, making it difficult to determine where hallucinations originate. We first organize existing benchmarks around these stages and show that their scores provide inconsistent diagnostic signals: stronger stage-level performance does not reliably imply lower downstream hallucination, and even benchmarks targeting the same capability can disagree. We therefore introduce a causal stage-intervention protocol that overwrites individual stages while holding the downstream task fixed. Across 60,008 runs on three video-agent architectures, we find that grounding is the dominant source of downstream error, with roughly four times the causal impact of corrupting visual observations. Successful grounding depends primarily on locating the correct region rather than precise temporal overlap, explaining why standard mIoU metrics poorly predict downstream reliability. We further find that incorrect evidence is substantially more harmful than missing evidence. Finally, auditing existing benchmarks against these interventions reveals that their scores do not reliably predict causal cascade sensitivity and can fail under distribution shift. These results motivate intervention-based, stage-aware evaluation for trustworthy video agents.

Sources

Related papers