RoboJEPA: Scaling Robotic Latent World Models
cs.AI, cs.RO
Submitted: 2026-10-07
Updated: 2026-10-07
Code: https://github.com/facebookresearch/robo_jepa
Project page: https://robojepa.github.io
License: http://creativecommons.org/licenses/by/4.0/
The gist: Latent world models have shown a remarkable ability to predict future states and to plan in the real world.
Terminology
Abstract
Latent world models have shown a remarkable ability to predict future states and to plan in the real world. In practice, however, we lack a principled way to estimate how their capabilities scale with model size, data, and compute, an open problem that slows progress in the field. In this work we present RoboJEPA, a world model based on the Joint Embedding Predictive Architecture (JEPA) and trained on a large-scale dataset spanning 12 robotic embodiments. We show that RoboJEPA's imagination error, the error of its latent rollouts, follows a second-order power law in compute, allowing us to predict model quality well beyond the scale at which the law is fit. We further show that downstream robotic planning performance improves predictably with compute, and that imagination error is strongly correlated with it, making it a reliable proxy for real-robot evaluation. Finally, we demonstrate that latent world models can be deployed zero-shot as robotic agents, planning toward a single goal image to solve tasks requiring long-horizon planning on real hardware. We release all model checkpoints together with our training and robot deployment code. To our knowledge, this is the first work to establish scaling laws for multi-embodiment robotic world models trained on real robot data, and RoboJEPA, at 8B parameters, is the largest JEPA predictor model trained to date.
Sources
- AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systems
- V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning
- Back to the Features: DINO as a Foundation for Video World Models
- $\pi_0$: A Vision-Language-Action Flow Model for General Robot Control
- $\pi_{0.5}$: a Vision-Language-Action Model with Open-World Generalization
- IntPhys 2: Benchmarking Intuitive Physics Understanding In Complex Synthetic Environments
- Broken Neural Scaling Laws
- Unified Neural Scaling Laws
- Mastering Diverse Domains through World Models
- Training Agents Inside of Scalable World Models
- Gaussian Error Linear Units (GELUs)
- Scaling Laws for Autoregressive Generative Modeling
- Classifier-Free Diffusion Guidance
- GAIA-1: A Generative World Model for Autonomous Driving
- MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies
- PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulation
- MT-Opt: Continuous Multi-Task Robotic Reinforcement Learning at Scale
- Scaling Laws for Neural Language Models
- DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems