FastOPD: On-Policy Distillation for Lightweight VLA Deployment
cs.RO, cs.AI, cs.CV, cs.LG
Submitted: 2026-10-02
Updated: 2026-10-02
Comments: Project page: https://fastopd.github.io/
Code: https://github.com/huggingface/lerobot
Project page: https://fastopd.github.io
License: http://creativecommons.org/licenses/by/4.0/
The gist: Vision-Language-Action (VLA) foundation models have scaled rapidly to enhance manipulation performance and generalizability, but this scaling incurs high computational costs that render real-world
Terminology
Abstract
Vision-Language-Action (VLA) foundation models have scaled rapidly to enhance manipulation performance and generalizability, but this scaling incurs high computational costs that render real-world deployment increasingly challenging. Existing approaches typically mitigate this issue by designing smaller architectures or reducing the iterative denoising steps in flow-based policies. In this work, we propose FastOPD, a foundation-to-lightweight VLA framework that enables the practical deployment of large-scale VLAs through efficient on-policy distillation. Specifically, FastOPD adapts a flow map for single-state teacher supervision and combines it with a self-consistency objective to construct a compact student that learns the teacher dynamics. Furthermore, we theoretically demonstrate that minimizing this objective allows the distilled student to recover a distribution on par with that induced by an ideal few-step teacher model. We evaluate FastOPD across diverse foundation policies in simulation and real-world experiments. On LIBERO, FastOPD retains 84% of the performance of π 0.5 with only two inference steps, reducing inference latency by 78.1% while outperforming existing few-step distillation baselines in average success rate. With LingBot-VLA as the teacher, FastOPD improves the single-step success rate over the base student by 15.9 percentage points on RoboTwin 2.0. We further demonstrate its applicability to a World Action Model (WAM) and deploy a compact student distilled from MolmoAct2 on a real robot.
Sources
- GR00T N1: An Open Foundation Model for Generalist Humanoid Robots
- Flow map matching with stochastic interpolants: A mathematical framework for consistency models
- RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulation
- MolmoAct2: Action Reasoning Models for Real-world Deployment
- Flow-OPD: On-Policy Distillation for Flow Matching Models
- ReactVLA: Fast and Lightweight Reactive Robot Manipulation via Improved Mean Flow Action Generation
- Distilling the Knowledge in a Neural Network
- Score and Distribution Matching Policy: Advanced Accelerated Visuomotor Policies via Matched Distillation
- Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planning
- One-Step Flow Policy: Self-Distillation for Fast Visuomotor Policies
- RDT-1B: a Diffusion Foundation Model for Bimanual Manipulation
- SnapFlow: One-Step Action Generation for Flow-Matching VLAs via Progressive Self-Distillation
- A Comprehensive Survey on Knowledge Distillation
- SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics
- A Pragmatic VLA Foundation Model
- World Action Models are Zero-shot Policies
- Fast-WAM: Do World Action Models Need Test-time Future Imagination?
- VLA-OPD: Bridging Offline SFT and Online RL for Vision-Language-Action Models via On-Policy Distillation
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies