DeltaWAM: Delta World Action Models for Bimanual Manipulation
cs.CV, cs.RO
Submitted: 2026-09-23
Updated: 2026-09-23
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
The gist: World-action models (WAMs) transfer visual and motion priors from pretrained video generators to robot control by jointly modeling visual dynamics and actions.
Terminology
Abstract
World-action models (WAMs) transfer visual and motion priors from pretrained video generators to robot control by jointly modeling visual dynamics and actions. Existing WAMs, however, predict dense future frames during training, repeatedly modeling largely unchanged content and coupling action-conditioned dynamics to nuisance appearance variations. At inference, processing each complete observation with the heavy video expert bottlenecks few-step action generation. Accordingly, we propose DeltaWAM, which jointly predicts visual deltas and actions using dense-anchor, sparse-delta, and action streams, with three architectures that differ in representation and computation sharing. We further develop Streaming Delta Memory (SDM), which updates cached anchor context with compact observed deltas, reducing heavy video-expert processing. On RoboTwin, DeltaWAM with SDM improves average success over Fast-WAM from 81.3% to 85.4% in the clean setting and from 75.8% to 83.9% under visual randomization. The three architectures reduce training FLOPs by 17.78-23.77%, while SDM reduces one-step inference latency and FLOPs by 36.57% and 31.55%, respectively; real-world evaluations further show the highest overall success rate and normalized progress among the evaluated policies. Code: https://github.com/AIGeeksGroup/DeltaWAM. Website: https://aigeeksgroup.github.io/DeltaWAM.
Sources
- GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulation
- Fast-WAM: Do World Action Models Need Test-time Future Imagination?
- GigaWorld-Policy: An Efficient Action-Centered World--Action Model
- GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearch
- DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos
- Wan: Open and Advanced Large-Scale Video Generative Models
- RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulation
- Generative Control as Optimization: Time Unconditional Flow Matching for Adaptive and Robust Robotic Control
- $\pi_{0.5}$: a Vision-Language-Action Model with Open-World Generalization
- RoboCOIN: An Open-Sourced Bimanual Robotic Data Collection for Integrated Manipulation
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models