Foresight at the Event Boundary: Evaluating Physical Prediction in Video World Models
cs.CV
Submitted: 2026-09-29
Updated: 2026-10-04
Comments: 8 pages, 2 figures, 6 tables
License: http://creativecommons.org/licenses/by/4.0/
The gist: Video world models are largely regarded as predictive models of the physical world and are therefore expected to anticipate the consequences of observed events.
Terminology
Abstract
Video world models are largely regarded as predictive models of the physical world and are therefore expected to anticipate the consequences of observed events. However, evaluation has mainly focused on reference similarity, physical-law consistency, or judgment plausibility, estimating anticipation only indirectly. We address this directly: when a release or impact has just occurred but its consequence is withheld, can a world model anticipate what should happen next? We introduce an event-anchored evaluation based on 62 controlled real-world free-fall recordings and 124 clips spanning three object types, with fine-grained release and impact annotations and ground-truth trajectories. The protocol separates consequence production, temporal placement, and physical realization. Across six contemporary video generation and world models, Runway and Veo produce release and subsequent impact events at rates above 93% but often initiate them substantially late, whereas Cosmos-Predict-2.5 and MAGI-1 frequently preserve the pre-event state and produce little or no measurable consequence. Among measurable falls, plausible timing does not necessarily imply physically consistent motion. We further conduct a 15-participant, 20-condition human study in which participants describe the expected consequence from a single event-anchored frame and draw its trajectory. Human predictions favor the recorded future in aggregate while revealing genuine ambiguity among plausible continuations. Overall, physical foresight emerges as a sequence of distinct challenges: initiating a consequence, anchoring it in time, and realizing its motion.
Sources
- World Simulation with Video Foundation Models for Physical AI
- PhyGround: Benchmarking Physical Reasoning in Generative World Models
- Physics-IQ Verified
- MAGI-1: Autoregressive Video Generation at Scale
- WorldBench: Disambiguating Physics for Diagnostic Evaluation of World Models
- Evaluating Newtonian Mechanics in Video Generative Models with Real Physical Systems
- Physion-Eval: Evaluating Physical Realism in Generated Video via Human Reasoning
- PhyWorld: Physics-Faithful World Model for Video Generation
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models