StairVLA: Stage-Aware Hierarchical Action Generation for Vision-Language-Action Models
cs.RO
Submitted: 2026-10-06
Updated: 2026-10-07
Comments: Project page: https://dicomsky.github.io/projects/stairvla
Project page: https://dicomsky.github.io/projects/stairvla
License: http://creativecommons.org/licenses/by/4.0/
The gist: Vision-language-action (VLA) models increasingly rely on diffusion- or flow-matching-based action heads to generate continuous robot actions.
Abstract
Vision-language-action (VLA) models increasingly rely on diffusion- or flow-matching-based action heads to generate continuous robot actions. These action heads typically process the denoising trajectory in a largely uniform manner. However, we observe that the conditioning focus naturally shifts across denoising stages: early stages combine language instructions and visual observations to establish a coarse action trajectory, whereas later stages place greater emphasis on current visual observations for action alignment. Based on this insight, we introduce StairVLA, a stage-aware hierarchical action generation framework that uses partially denoised actions as a natural interface between coarse long-horizon action generation and local refinement. A high-level VLA performs early denoising to produce a reusable long-horizon partially denoised action trajectory, while a lightweight refiner operates at a higher frequency to refine local action chunks using the latest observations. This design amortizes expensive high-level VLA computation while preserving frequent closed-loop correction. On LIBERO, our GR00T-style instantiation improves average success from 96.5% to 97.8% while reducing amortized inference latency from 115.0 ms to 44.2 ms per action chunk. More broadly, across two VLA backbones, simulation benchmarks, and real-robot tasks, StairVLA consistently reduces inference cost while maintaining strong task performance.
Sources
- eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers
- GR00T N1: An Open Foundation Model for Generalist Humanoid Robots
- $\pi_0$: A Vision-Language-Action Flow Model for General Robot Control
- StreamVLA: Breaking the Reason-Act Cycle via Completion-State Gating
- Responsive Noise-Relaying Diffusion Policy: Responsive and Efficient Visuomotor Control
- OpenHelix: A Short Survey, Empirical Analysis, and Open-Source Dual-System VLA Model for Robotic Manipulation
- CF-VLA: Efficient Coarse-to-Fine Action Generation for Vision-Language-Action Policies
- HiMoE-VLA: Hierarchical Mixture-of-Experts for Generalist Vision-Language-Action Policies
- A Fourier Space Perspective on Diffusion Models
- NeuroVLA: A Brain-inspired Embodied Intelligence for Fluid and Fast Reflexive Robotics Control
- Look Before You Leap: Unveiling the Power of GPT-4V in Robotic Vision-Language Planning
- OpenVLA: An Open-Source Vision-Language-Action Model
- Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success
- MOKA: Open-World Robotic Manipulation through Mark-Based Visual Prompting
- T-Rex: Tactile-Reactive Dexterous Manipulation
- FAST: Efficient Action Tokenization for Vision-Language-Action Models
- $\pi_{0.5}$: a Vision-Language-Action Model with Open-World Generalization
- StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing
- UniFS: Unified Fast-to-Slow Hierarchical Architecture for Vision-Language-Action Models
- Coarse-to-Control: Action-Token Planning for Vision-Language-Action Models
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies