What Language Does and What the Evidence Supports: A Functional Role Taxonomy and Evidence Audit of Language Grounding in Embodied Agents
Yifan Guo, Chenghao Li, Zhu Wang, Wei Xu, Yu Li, Yulong Zhu, Zhuo Sun, Bin Guo, Zhiwen Yu
cs.CL
Submitted: 2026-08-04
Comments: 19 pages, 3 figures, 11 tables
License: http://creativecommons.org/licenses/by/4.0/
The gist: Foundation models place language throughout embodied agents, but its presence does not show what it contributes or how well that contribution is grounded.
Terminology
Abstract
Foundation models place language throughout embodied agents, but its presence does not show what it contributes or how well that contribution is grounded. This survey separates these two questions. We define five non-exclusive functional roles for language: Specification, Embodied Representation, Action Orchestration, Grounding Regulation, and Execution Coupling. For each role, we trace the path from linguistic content to its embodied consumer and identify the observations or interventions that can test the claimed responsibility. Applying this framework to the reviewed literature reveals a recurring gap between functional use and evidential support. Interpretable or revised linguistic intermediates may be incorrect, go unused, or fail to affect later behavior. Even when actions are directly conditioned on language, system-level success does not by itself isolate language's contribution. We therefore evaluate grounding claim by claim, asking whether the reported evidence supports the specific responsibility assigned to language. Using role claims rather than architectures as the unit of comparison allows us to compare modular and end-to-end embodied agents without extending conclusions beyond the reported evidence.
Sources
- Do As I Can, Not As I Say: Grounding Language in Robotic Affordances
- RT-H: Action Hierarchies Using Language
- GR00T N1: An Open Foundation Model for Generalist Humanoid Robots
- $\pi_0$: A Vision-Language-Action Flow Model for General Robot Control
- $A^2$Nav: Action-Aware Zero-Shot Robot Navigation by Exploiting Vision-and-Language Ability of Foundation Models
- AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulation
- The Semantic Lifecycle in Embodied AI: Acquisition, Representation and Storage via Foundation Models
- Scene-LLM: Extending Language Model for 3D Visual Understanding and Reasoning
- Mobility VLA: Multimodal Instruction Navigation with Long-Context VLMs and Topological Graphs
- TLA: Tactile-Language-Action Model for Contact-Rich Manipulation
- LAGEA: Language Guided Embodied Agents for Robotic Manipulation
- Dynamic Planning with a LLM
- Learning from Trials and Errors: Reflective Test-Time Planning for Embodied LLMs
- Fast-ThinkAct: Efficient Vision-Language-Action Reasoning via Verbalizable Latent Planning
- EmbodiSkill: Skill-Aware Reflection for Self-Evolving Embodied Agents
- Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model
- CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation
- Large Model Empowered Embodied AI: A Survey on Decision-Making and Embodied Learning
- Towards A Unified Agent with Foundation Models
- OneTwoVLA: A Unified Vision-Language-Action Model with Adaptive Reasoning
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering