AgenticNav: Zero-Shot Vision-and-Language Navigation as a Tool-Calling Harness
AgenticNav rethinks zero-shot vision-and-language navigation by treating it as an agentic tool-calling process. It exposes action, depth, and memory as callable tools for a vision model. This harness allows the VLM to directly select targets, request metric depth for safety checks, and selectively recall past experiences from a compact map image. The method achieves state-of-the-art results by improving how the model interacts with its environment.