HelloWorld: Towards Practical Applications of Generative Driving World Models

arXiv:2609.28931 · cs.CV · Submitted 2026-09-24 · Read on arXiv

cs.CV

Submitted: 2026-09-24

Updated: 2026-09-24

Comments: website: https://helloworld-4d.github.io

Project page: https://helloworld-4d.github.io

License: http://creativecommons.org/licenses/by/4.0/

The gist: Driving world models provide a promising route toward scalable counterfactual data generation and interactive simulation beyond recorded driving logs.

Terminology

Abstract

Driving world models provide a promising route toward scalable counterfactual data generation and interactive simulation beyond recorded driving logs. Realizing this potential requires a system that can generalize across diverse scenes, respond faithfully to prescribed controls, generate coherent multi-sensor observations, and operate efficiently under repeated inference. We present HelloWorld, a 2B driving world model system designed around these requirements. HelloWorld progressively specializes broad visual and motion priors from heterogeneous video data into controllable driving generation using ego pose, HD maps, and 3D boxes. A block-causal generation interface, together with adaptation to self-generated context, aligns the model with sequential simulation. The system further supports synchronized seven-camera RGB generation and conditional LiDAR synthesis, and is distilled toward few-step inference for efficient deployment. Experiments evaluate visual quality, control fidelity, cross-view consistency, robustness under repeated generation, inference efficiency, and LiDAR synthesis. Together, HelloWorld provides a unified framework for scalable driving data generation and interactive simulation.

Sources

Related papers