CrossSafe: Towards Cross-Embodiment Latent Safety Filters
cs.RO, cs.AI, cs.LG, cs.SY, eess.SY
Submitted: 2026-09-24
Updated: 2026-09-30
Comments: Updated acknowledgements section
Project page: https://trustworthyautonomy.github.io/CrossSafe
License: http://creativecommons.org/licenses/by/4.0/
The gist: Cross-embodiment learning has shown that a single model, such as a vision-language-action (VLA) model, can learn state representations and manipulation skills that can be applied across heterogeneous
Terminology
Abstract
Cross-embodiment learning has shown that a single model, such as a vision-language-action (VLA) model, can learn state representations and manipulation skills that can be applied across heterogeneous robots to accomplish various tasks. We hypothesize that the same holds for safety enforcement. The reasoning required to satisfy a safety constraint, such as detecting an obstacle, recognizing that it should be avoided, and selecting a safe abstract action, is largely shared across robots. What differs across embodiments is how the abstract safe action is realized: morphology, kinematics, and dynamics determine which actions are safe and feasible. Consequently, the same action can be safe for one robot and unsafe for another. This is especially important for generalist manipulation policies that operate in a common end-effector action space without explicitly capturing how safety depends on the robot's morphology and kinematics. We propose embodiment-conditioned safety filtering, in which a Hamilton-Jacobi reachability-based value function and its corresponding safety-maximizing policy are shared across robots. Using a morphology-aware latent representation of the robot and its environment, we perform Hamilton-Jacobi reachability analysis directly in latent space so that the learned safety concepts can generalize across embodiments while remaining explicitly conditioned on each robot's morphology and kinematics. We evaluate our approach across five bimanual robot embodiments and five manipulation tasks with whole-body collision-avoidance constraints. Our results show that a single policy, jointly trained across five manipulation tasks and four embodiments, exhibits zero-shot generalization to a held-out embodiment, reducing the nominal policy's collision rate. They also show that training using more embodiments improves generalization.
Sources
- Open X-Embodiment: Robotic Learning Datasets and RT-X Models
- Scaling Cross-Embodied Learning: One Policy for Manipulation, Navigation, Locomotion and Aviation
- X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Model
- HoloBrain-0 Technical Report
- ACE-Ego-0: Unifying Egocentric Human and Robotic Data for VLA Pretraining
- GraspGen-X: Cross-Embodiment 6-DOF Diffusion-based Grasping
- DexGrasp-Zero: A Morphology-Aligned Policy for Zero-Shot Cross-Embodiment Dexterous Grasping
- OpenVLA: An Open-Source Vision-Language-Action Model
- EmbodiSteer: Steering Embodiment-Agnostic Visuomotor Policies with Joint-Space Guidance for Zero-Shot Cross-Embodiment Deployment
- X-Safe: Embodiment-Agnostic Safeguarding for Robot Arm Manipulation Policies via Action Masking
- RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulation
- $\pi_{0.5}$: a Vision-Language-Action Model with Open-World Generalization
- GEAR-VLA: Learning Geometry-Aware Action Representations for Generalizable Robotic Manipulation
- CEI: A Unified Interface for Cross-Embodiment Visuomotor Policy Learning in 3D Space
- Cross-Embodiment Transfer via Behavior-Aligned Representations
- Training Vision-Language-Action Models with Dense Embodied Chain-of-Thought Supervision
- GET-Zero: Graph Embodiment Transformer for Zero-shot Embodiment Generalization
- EAGG: Embodiment-Aligned Grasp Generation via Geometry-Aware Graph Conditioning
- One Policy to Run Them All: an End-to-end Learning Approach to Multi-Embodiment Locomotion
- Toward Hardware-Agnostic Quadrupedal World Models via Morphology Conditioning
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies