HarnessVLN: Unifying Training-Free Embodied Navigation through an Agent Harness

arXiv:2609.15195 · cs.RO · Submitted 2026-09-14 · Read on arXiv

cs.RO

Submitted: 2026-09-14

Updated: 2026-09-29

Project page: https://agibot-harnessvln.netlify.app

License: http://creativecommons.org/licenses/by/4.0/

The gist: Embodied navigation requires agents to ground instructions or object goals in spatial observations and translate plans into successful execution.

Terminology

Abstract

Embodied navigation requires agents to ground instructions or object goals in spatial observations and translate plans into successful execution. As multimodal large language models (MLLMs) become increasingly capable, they offer stronger support for navigation without task-specific training; however, improved semantic reasoning alone does not ensure that proposed actions remain consistent with spatial evidence, task progress, and execution outcomes. We introduce HarnessVLN, a zero-shot, training-free framework that unifies instruction-following and object-goal navigation through a shared Agent Harness. The Harness coordinates perception, memory, and execution tools through a unified interface, validating planner proposals for evidential support, geometric feasibility, and subgoal consistency before dispatch. It jointly manages hierarchical event memory and a persistent Spatiotemporal Graph to track task progress, preserve spatial evidence, and contextualize failures. Structured execution feedback updates this shared state, guiding subsequent planning, recovery, and termination. Across R2R, RxR, HM3D-v2, and HM3D-OVON, HarnessVLN achieves success rates of 59.6%, 51.4%, 76.0%, and 59.3%, respectively, outperforming prior training-free methods. Humanoid robot deployment further demonstrates its applicability to both navigation tasks in real-world environments. The project page is available at [https://agibot-harnessvln.netlify.app/].

Sources

Related papers