GLIMPSE: Global-Local Indexing with Multi-Precision Spectral Encoding for Explorable Video World Models
cs.CV
Submitted: 2026-10-09
Updated: 2026-10-09
Comments: 21 pages, 8 figures
License: http://creativecommons.org/licenses/by/4.0/
The gist: A camera-controlled video world model must keep a scene consistent when the camera returns to it.
Terminology
Abstract
A camera-controlled video world model must keep a scene consistent when the camera returns to it. Memories that render stored features into the target frame can turn depth and pose errors into ghosting or duplicated structure. Positional transport avoids that resampling by relocating a historical patch's address rather than its content, but assigns full positional precision even to inaccurate projections. We present GLIMPSE, a global-local memory interface with band-wise multi-precision coordinates and geometry-conditioned spectral attenuation to reduce sensitivity to inaccurate projected addresses. Local patch memory supplies view-specific appearance, while recurrent global memory provides scene context. Footprint-guided retrieval selects historical patches under a fixed local read budget. Under matched retrieval and read budgets, GLIMPSE improves geometric correspondence and photometric consistency over deterministic positional transport.
Sources
- AlayaWorld: Long-Horizon and Playable Video World Generation
- MeMix: Writing Less, Remembering More for Streaming 3D Reconstruction
- DreamX-World 1.0: A General-Purpose Interactive World Model
- CameraCtrl: Enabling Camera Control for Text-to-Video Generation
- Vid2World: Crafting Video Diffusion Models to Interactive World Models
- INSPATIO-WORLD: A Real-Time 4D World Simulator via Spatiotemporal Autoregressive Modeling
- Depth Anything 3: Recovering the Visual Space from Any Views
- Lyra 2.0: Explorable Generative 3D Worlds
- History-Guided Video Diffusion
- WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling
- Wan: Open and Advanced Large-Scale Video Generative Models
- SpatialVID: A Large-Scale Video Dataset with Spatial Annotations
- Latent Spatial Memory for Video World Models
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Geometry-Aware Implicit Memory for Video World Models
- Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory
- Video World Models with Long-term Spatial Memory
- Addressable Memory for Video World Models
- WorldMem: Long-term Consistent World Simulation with Memory
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models