A Safe Action Is Not Enough: Feasible-Future Decoding for Vision-Language-Action Policies
cs.AI, cs.RO
Submitted: 2026-10-04
Updated: 2026-10-06
Project page: https://simple-robotics.github.io/publications/contact-models
License: http://creativecommons.org/licenses/by/4.0/
The gist: A safe action is not necessarily a viable one.
Abstract
A safe action is not necessarily a viable one. A frozen vision-language-action (VLA) policy can favor a locally admissible move that leaves no policy-supported route to safe task completion. We call this the feasibility-likelihood gap: likelihood ranks the next move, while feasibility depends on the futures it leaves open. To bring those futures into the decision, we derive the exact next-block marginal of the history-conditioned policy-environment trajectory law restricted to safe task completion. The derivation reveals a candidate-dependent feasible-future mass: its support records whether safe completion remains possible under the frozen continuation process, while its magnitude measures how much weighted safe-completion mass remains. Since exact evaluation is impractical online, we develop a selective finite-candidate approximation and establish conditions for recovering the best retained viable candidate. Our alarm-triggered, training-free reranker VICS-G lowers mean cumulative safety cost by 1.9%-57.5% across six Safety-CHORES settings while remaining within 2.5 percentage points of policy sampling in success and 0.82 steps in mean episode length. Our approach offers a promising and practical path toward safer task completion, grounded in an exact policy-relative target yet requiring neither policy retraining nor online rollouts.
Sources
- Safe Reinforcement Learning via Shielding
- Hamilton-Jacobi Reachability: A Brief Overview and Recent Advances
- $\pi_0$: A Vision-Language-Action Flow Model for General Robot Control
- RT-1: Robotics Transformer for Real-World Control at Scale
- RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control
- PaLM-E: An Embodied Multimodal Language Model
- The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systems
- Tree-OPO: Off-policy Monte Carlo Tree-Guided Advantage Optimization for Multistep Reasoning
- On Almost Surely Safe Alignment of Large Language Models at Inference-Time
- Constrained Decoding for Safe Robot Navigation Foundation Models
- OpenVLA: An Open-Source Vision-Language-Action Model
- Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Review
- Safe Offline Reinforcement Learning with Real-Time Budget Constraints
- NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristics
- The Model Knows, the Decoder Finds: Future Value Guided Particle Power Sampling
- Octo: An Open-Source Generalist Robot Policy
- FAST: Efficient Action Tokenization for Vision-Language-Action Models
- Saute RL: Almost Surely Safe Reinforcement Learning Using State Augmentation
- A predictive safety filter for learning-based control of constrained nonlinear dynamical systems
- FUDGE: Controlled Text Generation With Future Discriminators
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems