R squared-WAM: Repair-and-Reject Post-Training for World Action Models
cs.RO
Submitted: 2026-10-04
Updated: 2026-10-07
Comments: 24 pages, 7 figures
Code: https://github.com/Lijiaxin0111/Open-d4rt
Project page: https://r2-wam.github.io
License: http://creativecommons.org/licenses/by/4.0/
The gist: World Action Models (WAMs) emerge as a promising foundation for policy refinement by predicting the consequences of sampled actions.
Abstract
World Action Models (WAMs) emerge as a promising foundation for policy refinement by predicting the consequences of sampled actions. However, visually plausible predictions can mislead policy refinement if they fail to reflect the input actions. To address this mismatch, we introduce R squared-WAM, a two-stage repair-and-reject post-training framework that first improves the consistency of predicted futures with input actions, then uses these futures to select inferior action samples for negative fine-tuning. The repair stage grounds imagination in observed robot behavior through a kinematic alignment score that measures agreement between predicted and demonstrated motion, enabling the predicted video to faithfully reflect its input actions. Using the repaired video model, the rejection stage compares imagined outcomes of sampled and demonstrated actions, selectively applying negative fine-tuning to samples whose predicted task progress falls below the demonstrated reference by a prescribed margin. Together, the two stages extend video prediction from representation learning to consequence-based policy refinement without additional environment interaction or changes to the inference procedure. R squared-WAM achieves 93.8% average success on RoboTwin 2.0 across clean and randomized settings. On the long-horizon real-world Fold Shirt task, it achieves 87.5% average success, compared with 0% for Fast-WAM. Our project page is available at https://r2-wam.github.io/.
Sources
- $\pi_0$: A Vision-Language-Action Flow Model for General Robot Control
- RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulation
- Dream2Flow: Bridging Video Generation and Open-World Manipulation with 3D Object Flow
- VLAW: Iterative Co-Improvement of Vision-Language-Action Policy and World Model
- Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representations
- NORA-1.5: A Vision-Language-Action Model Trained using World Model- and Action-based Preference Rewards
- $\pi^{*}_{0.6}$: a VLA That Learns From Experience
- $\pi_{0.5}$: a Vision-Language-Action Model with Open-World Generalization
- WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RL
- Causal World Modeling for Robot Control
- RoboFlow4D: A Lightweight Flow World Model Toward Real-Time Flow-Guided Robotic Manipulation
- HoloBrain-0 Technical Report
- STEAM: Self-Supervised Temporal Ensemble Advantage Modeling for Real-World Robot Learning
- WorldScape Policy 2.0: Empowering Steerable World Action Modeling with Reasoning-Augmented Memory and In-Context Learning
- Wan: Open and Advanced Large-Scale Video Generative Models
- EVA: Aligning Video World Models with Executable Robot Actions via Inverse Dynamics Rewards
- A Pragmatic VLA Foundation Model
- RISE: Self-Improving Robot Policy with Compositional World Model
- MiraBench: Evaluating Action-Conditioned Reliability in Robotic World Models
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies