Same Tasks, Different Apps: Why Mobile GUI Agents Fail to Generalize?
cs.AI
Submitted: 2026-09-28
Updated: 2026-09-28
Project page: https://anyappbench.github.io
Sources
- Auto-Eval Judge: Towards a General Agentic Framework for Task Completion Evaluation
- A3: Android Agent Arena for Mobile GUI Agents with Essential-State Procedural Evaluation
- UI-Ins: Enhancing GUI Grounding with Multi-Perspective Instruction-as-Reasoning
- VenusBench-Mobile: A Challenging and User-Centric Benchmark for Mobile GUI Agents with Capability Diagnostics
- MobiBench: Multi-Branch, Modular Benchmark for Mobile GUI Agents
- MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments
- Benchmarking Mobile Device Control Agents across Diverse Configurations
- On the Effects of Data Scale on UI Control Agents
- AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectories
- ColorBench: Benchmarking Mobile Agents with Graph-Structured Framework for Complex Long-Horizon Tasks
- OS-ATLAS: A Foundation Action Model for Generalist GUI Agents
- Mobile-Bench-v2: A More Realistic and Comprehensive Benchmark for VLM-based Mobile Agents
- Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4V
- GUIDE: Interpretable GUI Agent Evaluation via Hierarchical Diagnosis
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems