MAE I Trust Myself? Self-Evaluating VLA Action Generation with Markov Attention Entropy
cs.AI
Submitted: 2026-08-17
Updated: 2026-09-30
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
The gist: Vision-Language-Action models (VLAs) integrate visual perception, language instruction, and action generation into end-to-end policies across heterogeneous architectures.
Terminology
Abstract
Vision-Language-Action models (VLAs) integrate visual perception, language instruction, and action generation into end-to-end policies across heterogeneous architectures. However, enabling VLAs to self-evaluate their action generation reliability without external supervision remains a major challenge. Existing methods either rely on expert annotations or estimate uncertainty only from output statistics, largely ignoring internal signals. In this work, we observe that internal visual modality entropy exhibits consistent distinctions between successful and failed tasks across heterogeneous VLAs. Although VLAs' architectures differ in their action generation, we show that they share a common latent action generation abstraction evolving under visual perception, language instruction, and State Input, which we formulate as a Conditional Generative Markov Chain. Based on this formulation, we propose MAE (Markov Attention Entropy), a self-evaluation framework that directly converts internal attention signals into architecture-aware reliability scores, and introduce LIBERO-Reflect, a 4,000-episode benchmark combining 2,000 standard episodes and 2,000 challenging episodes across four subsets. Extensive experiments across heterogeneous VLA architectures and diverse scenarios show that MAE consistently outperforms state-of-the-art baselines on AUPR, AUROC, and FPR@95.
Sources
- CoT-Kinetics: A Theoretical Modeling Assessing LRM Reasoning Process
- RoboCat: A Self-Improving Generalist Agent for Robotic Manipulation
- RT-1: Robotics Transformer for Real-World Control at Scale
- Observing and Controlling Features in Vision-Language-Action Models
- Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback
- ReconVLA: An Uncertainty-Guided and Failure-Aware Vision-Language-Action Framework for Robotic Control
- Open X-Embodiment: Robotic Learning Datasets and RT-X Models
- RoVer: Robot Reward Model as Test-Time Verifier for Vision-Language-Action Model
- AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulation
- Not All Features Are Created Equal: A Mechanistic Study of Vision-Language-Action Models
- Look Before You Leap: An Exploratory Study of Uncertainty Measurement for Large Language Models
- Mechanistic interpretability for steering vision-language-action models
- Your Vision-Language-Action Model Already Has Attention Heads For Path Deviation Detection
- VIMA: General Robot Manipulation with Multimodal Prompts
- Language Models (Mostly) Know What They Know
- OpenVLA: An Open-Source Vision-Language-Action Model
- Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success
- Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMs
- Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generation
- RoboMonkey: Scaling Test-Time Sampling and Verification for Vision-Language-Action Models
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems