PathPainter: Transferring the Generalization Ability of Image Generation Models to Embodied Navigation

PathPainter is a navigation system that uses image generation models to interpret natural language and bird's-eye-view (BEV) images for ground robots. It generates traversability masks and plans global paths, overcoming long-term drift using cross-view localization. The system shows how foundation model vision capabilities can be applied to real robot navigation.

Open the full episode

More from Robotics Radio