VR-JEPA: Learning Contrastive-State Latent Guidance for Generation-based Video Reasoning
cs.CV
Submitted: 2026-09-30
Updated: 2026-09-30
Code: https://github.com/Wan-Video/Wan2.2
License: http://creativecommons.org/licenses/by/4.0/
The gist: Reasoning through video generation offers a promising path toward visual intelligence by modeling latent visual states and their dynamics.
Terminology
Abstract
Reasoning through video generation offers a promising path toward visual intelligence by modeling latent visual states and their dynamics. However, current video generation models often lack explicit guidance on how these states should evolve, leaving generated trajectories prone to physical and structural inconsistencies that undermine reasoning reliability. While the Video Joint-Embedding Predictive Architecture (V-JEPA) provides rich spatiotemporal priors learned through latent prediction, these general priors do not naturally adapt to the logical reasoning capabilities required for complex visual tasks. To bridge this gap, we propose VR-JEPA, a framework that aligns the V-JEPA predictor with task-specific reasoning logic through localized contrastive-state learning and uses its predicted latent trajectories to guide video generation for visual reasoning. Specifically, (i) we pair successful trajectories with generated alternatives under the same input conditions and use discrepancies in their V-JEPA representations to identify informative states and tokens for localized contrastive supervision. (ii) We further equip the V-JEPA predictor with skill-specific experts trained on anchor-task data, allowing the model to adaptively specialize its shared spatiotemporal priors across diverse cognitive domains. Together with skill-specific experts, this contrastive supervision enables VR-JEPA to predict latent trajectories that provide task-specific logical guidance for video generation. Comprehensive experiments on the large-scale VBVR-Pro-Bench dataset demonstrate that VR-JEPA achieves an 11.33% relative improvement over the cutting-edge generation-based reasoning baseline, significantly mitigating physical artifacts and enhancing logical consistency.
Sources
- Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture
- V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning
- VLMs are Good Teachers for Video Reasoning via Adaptive Test-Time Optimization
- World Models
- LTX-2: Efficient Joint Audio-Visual Foundation Model
- Video Diffusion Models
- HunyuanVideo: A Systematic Framework For Large Video Generative Models
- JEPA-Reasoner: Decoupling Latent Reasoning from Token Generation
- Wan-R1: Verifiable-Reinforcement Learning for Video Reasoning
- V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learning
- PhysVideoGenerator: Towards Physically Aware Video Generation via Latent Physics Guidance
- DINOv3
- Seedance 2.0: Advancing Video Generation for World Complexity
- Wan: Open and Advanced Large-Scale Video Generative Models
- A Very Big Video Reasoning Suite
- Video models are zero-shot learners and reasoners
- VISReg: Variance-Invariance-Sketching Regularization for JEPA training
- Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AI
- VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models