Skill-Space Shooting for Autonomous Robot Policy Improvement
cs.RO, cs.AI, cs.LG
Submitted: 2026-09-29
Updated: 2026-09-29
License: http://creativecommons.org/licenses/by/4.0/
The gist: Robots deployed in the physical world must be able to improve beyond their initial training as they encounter new situations and failures.
Terminology
Abstract
Robots deployed in the physical world must be able to improve beyond their initial training as they encounter new situations and failures. For this improvement to scale across tasks, it must make effective use of experience without requiring human demonstration of each correction. Recent agentic systems offer a way to reduce this reliance on human effort by using foundation models to autonomously compose learned behaviors to complete tasks. Yet completing tasks this way does not itself teach a task policy to overcome its own failures; that requires turning these behaviors into learnable corrections for the policy. Our insight is that many such corrections are familiar short behaviors, or skills: they recur across tasks and describe actions that foundation models can reason about from a scene. We introduce skill-space shooting, which uses foundation model guidance to explore corrections through these reusable skills and turn successful trials into policy improvement. Real-world experiments show repeated improvement in policies acting autonomously, while skills can also be shared to reduce the teaching needed to improve on new tasks. By making reusable skills a source of corrective supervision, skill-space shooting enables scalable and generalizable policy improvement within and across tasks. Additional results and videos at https://skill-space-shooting.github.io.
Sources
- UniIntervene: Agentic Intervention for Efficient Real-World Reinforcement Learning
- To Err is Robotic: Rapid Value-Based Trial-and-Error during Deployment
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
- Reset-Free Reinforcement Learning via Multi-Task Learning: Learning Dexterous Manipulation Behaviors without Human Intervention
- ReCoVLA: VLM-Guided Reward Compilation for Failure Recovery in Vision-Language-Action Policies
- RaC: Robot Learning for Long-Horizon Tasks by Scaling Recovery and Correction
- Recover, Discover, Plan: Learning Skills and Concepts from Robot Failures
- RoboClaw: An Agentic Framework for Scalable Long-Horizon Robotic Tasks
- FailSafe: Reasoning and Recovery from Failures in Vision-Language-Action Models
- ASPIRE: Agentic /Skills Discovery for Robotics
- Human-in-the-Loop Imitation Learning using Remote Teleoperation
- $\pi^{*}_{0.6}$: a VLA That Learns From Experience
- ValueFormer: Stage-Aware Value Labels for Online Failure Detection and VLA Post-Training
- Critic in the Loop: A Tri-System VLA Framework for Robust Long-Horizon Manipulation
- ProbeAct: Probe-Guided Training-Free Failure Recovery in Vision-Language-Action Models
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies