CARE: Certifying Acceleration for Vision-Language-Action Inference
cs.CL, cs.LG
Submitted: 2026-10-06
Updated: 2026-10-06
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: While vision-language-action (VLA) models have advanced rapidly, running them at every control step remains expensive.
Abstract
While vision-language-action (VLA) models have advanced rapidly, running them at every control step remains expensive. Prior work accelerates VLA inference using techniques like action chunking and visual-token pruning, typically evaluating based on latency and average task success. However, acceleration may discard information and break tasks the original policy would solve, a risk hidden by average metrics. Measuring these failures is challenging because action deviations compound over closed-loop trajectories, meaning task failure is only observable across full episodes. We therefore define an acceleration-induced failure via paired rollouts from identical initial conditions, tracking when the reference succeeds but the accelerated policy fails. To manage this, we introduce CARE, an approach for certified accelerator selection. CARE uses paired rollouts on a calibration set to provide finite-sample guarantees that acceleration-induced failure risk stays below a user-specified budget. It deploys the fastest certified candidate, falling back to the reference if none qualify. By relying only on terminal outcomes and measured compute, CARE applies unchanged across diverse acceleration mechanisms, while sequential testing and failure-triggered reference rollouts keep certification affordable. On four LIBERO suites with OpenVLA-OFT, CARE certifies 9.0 -- 10.8 times speedups while guaranteeing (at 95% confidence) that at least 85.8% of reference-solved episodes are preserved. Under tight budgets, selectors without guarantees exceed the budget in up to 75% of trials, whereas CARE stays within budget and its sequential form uses 78.9% fewer rollouts than exhaustive evaluation. CARE further generalizes to flow-step reduction for π 0.5, and to Qwen3.5-9B and Llama-3.1-8B agents in Crafter.
Sources
- Conformal Risk Control for Non-Monotonic Losses
- $\pi_0$: A Vision-Language-Action Flow Model for General Robot Control
- Small RL Controller, Large Language Model: RL-Guided Adaptive Sampling for Test-Time Scaling
- The Llama 3 Herd of Models
- Benchmarking the Spectrum of Agent Capabilities
- $\pi_{0.5}$: a Vision-Language-Action Model with Open-World Generalization
- OpenVLA: An Open-Source Vision-Language-Action Model
- Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success
- Efficiently Controlling Multiple Risks with Pareto Testing
- Towards Efficient Risk-Sensitive Policy Gradient: An Iteration Complexity Analysis
- Reinforcing Multimodal Reasoning Against Visual Degradation
- Bridging the Semantic-Action Gap in Visual Token Pruning for Efficient VLA Inference
- SpecPrune-VLA: Accelerating Vision-Language-Action Models via Action-Aware Self-Speculative Pruning
- Qwen3 Technical Report
- Parallel-Probe: Towards Efficient Parallel Thinking via 2D Probing
- LLMs Improving LLMs: Agentic Discovery for Test-Time Scaling
- Dream-RSI: Recursive Self-Improvement through Evolving Worlds
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering