Bridging the Morphology Gap: Adapting VLA Models to Dexterous Manipulation via Intent-Conditioned Fine-Tuning
summary
The gist
Pre-trained Vision-Language-Action (VLA) models provide useful semantic and spatial priors, yet their parallel gripper action interfaces do not specify how those priors should be realized by a…
In short
InDex adapts pre-trained Vision-Language-Action (VLA) models for dexterous manipulation by separating contact decision from hand trajectory generation. It derives a normalized grasp intent from retargeted demonstrations and uses this intent to condition a conditional diffusion model to generate morphology-specific hand actions. This approach addresses the bottleneck of post-reach arm–hand coordination.
Key concepts
- InDex
- A framework that adapts VLA models for dexterous tasks by factoring control into a task-space plan and embodiment realization. It predicts synchronized end-effector–intent chunks in Stage 1 and uses this intent to generate the final hand trajectory via conditional diffusion in Stage 2.
- Normalized Grasp Intent (γ)
- A scalar value derived from retargeted human demonstrations that aligns the contact phase without specifying a finger configuration. This single scalar represents a temporal coordination interface, allowing multiple hand configurations to share the same intent while context disambiguates the exact finger movements required.
- Stage 1 and Stage 2
- The framework is sequential: Stage 1 predicts synchronized end-effector–intent chunks conditioned on VLA context and proprioception (predicting *when* to contact). Stage 2 uses these predictions to generate the multi-joint hand trajectory via conditional diffusion (determining *how* to establish contact).
- Post-reach Arm–Hand Coordination
- The paper identifies this as the main difficulty in adapting parallel gripper VLAs. It means coordinating the arm's movement with the hand's action immediately after reaching an object, rather than just focusing on where the object is located.
Terminology used across episodes
This episode discusses
- Bridging the Morphology Gap: Adapting VLA Models to Dexterous Manipulation via Intent-Conditioned Fine-Tuning · Paper Radio
- pi 0: A Vision-Language-Action Flow Model for General Robot Control
- DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset
- AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation System
- Imitating Human Behaviour with Diffusion Models
- OpenVLA: An Open-Source Vision-Language-Action Model
- Language Conditioned Multi-Finger Dexterous Manipulation Enabled by Physical Compliance and Switching of Controllers
- robosuite: A Modular Simulation Framework and Benchmark for Robot Learning
- What Matters in Learning from Offline Human Demonstrations for Robot Manipulation
- UniVLA: Learning to Act Anywhere with Task-centric Latent Actions
The paper
Bridging the Morphology Gap: Adapting VLA Models to Dexterous Manipulation via Intent-Conditioned Fine-Tuning · Read on arXiv
Chuanke Pang, Junyi Huang, Zhijun Zhao, Yaobing Wang, Kun Xu, Xilun Ding
Beihang University · China Academy of Space Technology
Transcript
Introduction to the show: ident: Robotics Radio. Generated commentary on the latest robotics and control papers.
Rosa: I'm Rosa.
Dev: And I'm Dev, here with Taro.
Rosa: We're looking at the paper: "Bridging the Morphology Gap".
Dev: Here's the gist of the paper. Pre-trained Vision-Language-Action (VLA) models provide useful semantic and spatial priors, yet their parallel gripper action interfaces do not specify how those priors should be realized by a dexterous hand<ref:2606.12109#pg2>.
Rosa: InDex introduces an intent-conditioned adaptation framework that separates the decisions of when contact should be established and how a morphology-specific hand trajectory should establish it<ref:2606.12109#pg4>.
Dev: This framework derives a normalized grasp intent from retargeted demonstrations, predicting synchronized end-effector–intent chunks in Stage 1 and then generating multi-joint hand actions via conditional diffusion in Stage 2<ref:2606.12109#pg4>.
Rosa: The results identify post-reach arm–hand coordination, rather than object localization alone, as the principal bottleneck in adapting parallel-gripper VLAs to dexterous manipulation<ref:2606.12109#pg4>.
Paper summary: Rosa: So, wrapping up this discussion on "Bridging the Morphology Gap: Adapting VLA Models to Dexterous Manipulation via Intent-Conditioned Fine-Tuning," the main point is that we need a way to link what the vision language model understands about a task with the specific physical control needed for a hand to execute it.
Dev: They found that by deriving this normalized grasp intent from demonstrations and using it to condition a diffusion decoder, they successfully preserved the VLA's core reaching abilities while making the final grasp much more stable and task completion rates higher on tasks like Nut Assembly.
Taro: The real implication for us in autonomy research is that we don't need to just train these models to see objects; we need to teach them how to coordinate their arm motion with a specific, intent-driven hand trajectory when they get close enough for contact.
Rosa: It suggests that morphology transfer isn't just about copying shapes; it requires an explicit interface between the semantic task progress and the embodiment-specific control signals. This approach gives us a temporal reference for contact, which is useful when dealing with uncertain physical interactions.
Dev: I think what stands out is how they successfully separated the decision of *when* to establish contact from the decision of *how* to establish it via hand trajectory generation. That modularity seems really promising for building safer systems where we can predict potential failure modes at different stages.
Conclusion: Rosa: So, this paper is about bridging that gap between what Vision Language Action models know and how your actual physical hand needs to move for something like grasping an object correctly, using this intent conditioning idea they called InDex.
Dev: Yeah, it separates when you should even try to touch something from the specific way the fingers actually reach for it, which is a neat way to handle that coordination problem.
Taro: It seems they found that focusing on arm hand coordination instead of just figuring out where the object is located was actually the biggest sticking point in making these parallel grippers work for real tasks.
Rosa: Right, so the core idea is this normalized grasp intent which acts like a temporal signal telling the system when to engage and what kind of contact phase it needs to be in, without worrying about the exact finger configuration yet.
Dev: And they use that scalar intent to guide a diffusion process in a second stage, which lets them generate many different finger trajectories that all fit that same high-level intent.
Taro: It’s interesting because it means you don't have to design every single hand pose from scratch; you just need to provide the right temporal goal and the system figures out how to get there physically.
Rosa: The conclusion is really about treating this as a coordination problem, meaning we look at the whole process of getting there rather than just trying to make a single complex action move.
Dev: It suggests that for transferring skills from simulation or vision models to real dexterous manipulation, you need an interface that connects the semantic task progress with the physical control signals.
Taro: That means morphology transfer isn't just about copying shapes anymore; it requires this kind of coordination between what the system knows about the task and how it physically executes that task.
Rosa: It opens up a way to get much better grasp stability on real tasks like assembling nuts, because they focus on timing the hand movement right with the arm movement, not just pinpointing a location.
Dev: The next thing we need to see is how robust this works when things go wrong outside of that perfect simulation setup you saw in the validation experiments.
More episodes
- 2608.13438-ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models
- 2610.34593-Future Prediction as Training-Only Video Supervision for Pretrained VLA Policies
- 2610.35385-EmbodiedLab: Beyond Manipulation, Benchmarking Embodied Agents That Act to Know
- 2610.36378-Data-Driven Hamiltonian for Neural Optimal Control
- 2610.37275-A Heuristic for Scheduling Autonomous Vehicles at Intersections
- 2610.37288-Dynamic Coordination of Autonomous Vehicles at Intersections
- 2610.37632-Real-Time Coordination of Autonomous Vehicles at Intersections
- 2611.13779-Softness is something you also need! Why compliance helps control: information metrics of a passive walker with compliant ankle
- 2611.13411-Residual-Corrected Physics-Informed Neural Network KKL Observers with Input-to-State Stability Guarantees
- 2611.14488-Is Your Robot's Memory Just a Clock? Temporal Shortcuts in Memory-Augmented VLA Policies