VIA: Visual Interface Agent for Robot Control
VIA transforms robot control into an agentic task where a foundation model drives a manipulator via a browser-based 3D interface. Instead of fine-tuning models for robotics, VIA leverages existing general AI to operate software through visual tools like screenshots and clicks. This shows that powerful foundation models can control robots without needing specific robot training.