EgoSteer: An Open-Source Full-Stack System Towards Steerable Dexterous Manipulation from Egocentric Videos
This system addresses a lack of steerability in dexterous hand control by creating a full-stack pipeline. It curates egocentric videos into high-quality training data using EgoSmith, integrates this with a unified robot stack for expert correction, and trains an enhanced vision-language model called EgoSteer. This results in a system capable of fine-grained manipulation from real videos.