FingerEye: Learning Dexterous Manipulation with Continuous Vision-Tactile Sensing
FingerEye introduces a sensing and learning framework to improve robotic dexterity through continuous vision-tactile feedback during manipulation. It combines binocular RGB cameras with a compliant ring for contact wrench sensing, allowing the robot to perceive objects before contact and control it after contact, leading to significant success rate improvements across seven complex tasks.