VagueBench: Benchmarking the Robustness of Embodied Agents on Ambient Context Illusions
cs.AI, cs.CV
Submitted: 2026-11-02
Updated: 2026-11-02
Code: https://github.com/stardreaming/VagueBench
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- PaLM-E: An Embodied Multimodal Language Model
- Empowering Embodied Manipulation: A Bimanual-Mobile Robot Manipulation Dataset for Household Tasks
- BadRobot: Jailbreaking Embodied LLM Agents in the Physical World
- AGENTSAFE: Benchmarking the Safety of Embodied Agents on Hazardous Instructions
- Environmental Injection Attacks against GUI Agents in Realistic Dynamic Environments
- SafeAgentBench: A Benchmark for Safe Task Planning of Embodied LLM Agents
- NoVo: Norm Voting off Hallucinations with Attention Heads in Large Language Models
- Review of Hallucination Understanding in Large Language and Vision Models
- RoboView-Bias: Benchmarking Visual Bias in Embodied Agents for Robotic Manipulation
- AI2-THOR: An Interactive 3D Environment for Visual AI
- Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution
- InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Models
- GPT-4o System Card
- SafeMobile: Chain-level Jailbreak Detection and Automated Evaluation for Multimodal Mobile Agents
- Building Cooperative Embodied Agents Modularly with Large Language Models
- ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objects
- Voyager: An Open-Ended Embodied Agent with Large Language Models
- UP-VLA: A Unified Understanding and Prediction Model for Embodied Agent
- Detoxifying Large Language Models via Autoregressive Reward Guided Representation Editing
- ALFWorld: Aligning Text and Embodied Environments for Interactive Learning
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents