Holo-World: Unified Camera, Object and Weather Control for Video World Model

arXiv:2606.20083 · cs.CV · Submitted 2026-06-18 · Read on arXiv

cs.CV

Submitted: 2026-06-18

Updated: 2026-09-24

Comments: Project Page: https://xiangchenyin.github.io/Holo-World Code: https://github.com/XiangchenYin/Holo-World

Project page: https://xiangchenyin.github.io/Holo-World

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Alignment — 21× in this paper · explained in 1 episode
• World Model — 19× in this paper · explained in 7 episodes
• Benchmark — 12× in this paper · explained in 2 episodes
• Consistency — 11× in this paper · explained in 3 episodes
• Core — 8× in this paper · explained in 2 episodes
• Ablation — 5× in this paper · explained in 1 episode
• Accuracy — 4× in this paper · explained in 1 episode
• Diffusion Model — 4× in this paper · explained in 8 episodes
• Diffusion Models — 4× in this paper · explained in 6 episodes
• Transformer — 3× in this paper · explained in 2 episodes
• Fidelity — 2× in this paper · explained in 2 episodes
• Flow Matching — 2× in this paper · explained in 7 episodes
• Foundation Model — 2× in this paper · explained in 3 episodes
• Grounding — 2× in this paper · explained in 3 episodes
• Structural Control — 2× in this paper · explained in 2 episodes
• 3D Gaussian Splatting — 1× in this paper · explained in 2 episodes
• Adam — 1× in this paper · explained in 2 episodes
• Aggregation — 1× in this paper · explained in 1 episode
• Calibration — 1× in this paper · explained in 7 episodes
• Decoupling — 1× in this paper · explained in 2 episodes
• Entanglement — 1× in this paper · explained in 3 episodes
• Foundation Models — 1× in this paper · explained in 7 episodes
• Gaussian Splatting — 1× in this paper · explained in 4 episodes
• Generative Model — 1× in this paper · explained in 2 episodes
• Generative Modeling — 1× in this paper · explained in 3 episodes
• Generative Models — 1× in this paper · explained in 2 episodes
• Latent Space — 1× in this paper · explained in 7 episodes
• Provenance — 1× in this paper · explained in 3 episodes
• Trace — 1× in this paper · explained in 2 episodes

Sources

• World Simulation with Video Foundation Models for Physical AI
• Qwen3-VL Technical Report
• LongVie: Multimodal-Guided Controllable Ultra-Long Video Generation
• CameraCtrl: Enabling Camera Control for Text-to-Video Generation
• Matrix-game 2.0: An open-source, real-time, and streaming interactive world model
• Classifier-Free Diffusion Guidance
• Denoising Diffusion Probabilistic Models
• HunyuanVideo: A Systematic Framework For Large Video Generative Models
• Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Condition
• Flow Matching for Generative Modeling
• AutoWeather4D: Autonomous Driving Video Weather Conversion via G-Buffer Dual-Pass Editing
• Trace Anything: Representing Any Video in 4D via Trajectory Fields
• WorldMirror: Universal 3D World Reconstruction with Any-Prior Prompting
• Lyra 2.0: Explorable Generative 3D Worlds
• DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion
• WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling
• Wan: Open and Advanced Large-Scale Video Generative Models
• EPiC: Efficient Video Camera Control Learning with Precise Anchor-Video Guidance
• NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videos
• Matrix-Game: Interactive World Foundation Model

Related papers

• Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
• AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
• Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
• MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
• TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
• A Survey on Efficient Vision-Language-Action Models