Accurate Open-Loop Control of a Soft Continuum Robot Using Visually Learned Latent Dynamics
The research developed an open-loop control system for soft continuum robots using latent dynamics learned from video. By using Visual Oscillator Networks (VONs) with an attention broadcast decoder, the method maps image waypoints directly to latent states. This allows for reliable long-horizon control of the robot without needing real-time camera feedback.