GUITAR: Structured Failure Diagnosis of GUI Agents via State Transitions
cs.AI
Submitted: 2026-09-28
Updated: 2026-09-29
Code: https://github.com/sqzhang-lazy/GUITAR
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Sources
- Auto-GPT for Online Decision Making: Benchmarks and Additional Opinions
- GPT-4V in Wonderland: Large Multimodal Models for Zero-Shot Smartphone GUI Navigation
- AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agents
- NaturalGAIA: A Verifiable Benchmark and Hierarchical Framework for Long-Horizon GUI Tasks
- ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use
- GUIOdyssey: A Comprehensive Dataset for Cross-App GUI Navigation on Mobile Devices
- GUITester: Enabling GUI Agents for Exploratory Defect Discovery
- GUIDE: Interpretable GUI Agent Evaluation via Hierarchical Diagnosis
- WebGraphEval: Multi-Turn Trajectory Evaluation for Web Agents using Graph Representation
- UI-TARS: Pioneering Automated GUI Interaction with Native Agents
- Mobile-Agent-v3: Fundamental Agents for GUI Automation
- Aguvis: Unified Pure Vision Agents for Autonomous GUI Interaction
- OS-ATLAS: A Foundation Action Model for Generalist GUI Agents
- Qwen2.5-VL Technical Report
- UI-Venus-1.5 Technical Report
- Qwen3-VL Technical Report
- GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems