WSA 1: a 3D-Centric World-Spatial-Action Model for Generalizable Robot Control
cs.RO
Submitted: 2026-07-04
Updated: 2026-10-13
Code: https://github.com/zaleni/WSA
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: World-Action Models (WAMs) have emerged as a promising paradigm for robot control by using predicted world evolution to guide action generation.
Terminology
Abstract
World-Action Models (WAMs) have emerged as a promising paradigm for robot control by using predicted world evolution to guide action generation. However, existing WAMs largely follow a one-way world-to-action paradigm. Real-world interaction, in contrast, is inherently driven by bidirectional temporal causality with implicit physics: the evolving world informs what actions should be taken, while the executed actions, in turn, determine how the world evolves. Without explicitly modeling this action-to-world direction, WAMs cannot assess whether the consequences of their generated actions align with the world evolution they predict, preventing WAMs from capturing consistent interaction dynamics from video demonstrations and thereby constraining their generalization capabilities in real-world scenarios. In this paper, we introduce WSA 1, a new modeling paradigm for generalizable robot control. WSA 1 develops a World-Spatial-Action understanding by jointly modeling three interconnected processes: how actions transform the 3D world (world level), how spatial states evolve toward desired outcomes (spatial level), and how target 3D world guide appropriate robot behaviors (action level). By integrating these processes, WSA 1 enables more coherent and tightly coupled reasoning over embodied interactions. Compared with prior WAMs trained on tens of thousands of hours of real-robot data, WSA 1 leverages 6k hours of video demonstrations (only 1k from real robot), demonstrating strong data efficiency. Moreover, even our 3B-parameter WSA 1 surpasses larger WAMs with 6B-8B parameters, highlighting its parameter efficiency. Experiments show that WSA 1 achieves a 93.3% success rate on RoboTwin2.0, delivering an average 20% improvement over state-of-the-art models on real-world robot control tasks.
Sources
- Cosmos World Foundation Model Platform for Physical AI
- Qwen3-VL Technical Report
- Qwen2.5-VL Technical Report
- Motus: A Unified Latent Action World Model
- GR00T N1: An Open Foundation Model for Generalist Humanoid Robots
- $\pi_0$: A Vision-Language-Action Flow Model for General Robot Control
- AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systems
- InternVLA-A1: Unifying Understanding, Generation and Action for Robotic Manipulation
- RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulation
- EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Video
- Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planning
- Causal World Modeling for Robot Control
- SpatialVAM:Spatial-Aware Multi-View Video Diffusion as a Data-Efficient Robot Policy
- Depth Anything 3: Recovering the Visual Space from Any Views
- Mask World Model: Predicting What Matters for Robust Robot Policy Learning
- Being-H0.7: A Latent World-Action Model from Egocentric Videos
- mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAs
- Motubrain: An Advanced World Action Model for Robot Control
- Octo: An Open-Source Generalist Robot Policy
- Wan: Open and Advanced Large-Scale Video Generative Models
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies