Jev-Mobile: Jev as an Executor for Mobile GUI Agents
cs.AI, cs.SE
Submitted: 2026-09-24
Updated: 2026-09-24
License: http://creativecommons.org/publicdomain/zero/1.0/
The gist: Vision-language models (VLMs) have become a common foundation for autonomous mobile GUI agents, but most existing systems rely on the VLM for both planning and action grounding at nearly every
Terminology
Abstract
Vision-language models (VLMs) have become a common foundation for autonomous mobile GUI agents, but most existing systems rely on the VLM for both planning and action grounding at nearly every interaction step, leading to substantial latency and model-serving cost. We introduce Jev-Mobile, which shifts this paradigm to low-frequency VLM planning and high-frequency lightweight execution: the VLM specifies local goals, the accessibility tree defines a structured executable action space, and Jev, a fast typed decision model, repeatedly selects actions within this space. This design allows multiple GUI actions to be executed under a single VLM decision, reducing expensive VLM inference while preserving adaptive interaction. On the full AndroidWorld task suite, Jev-Mobile achieves 79% task success, compared with 78% for SeeAct-V and 84% for a Step-wise VLM baseline. Among successful trajectories, it reduces mean end-to-end execution time by 32.7% and mean model API cost by 73.4% relative to Step-wise VLM. These results show that decoupling high-level VLM reasoning from low-level action execution can substantially improve mobile GUI agent efficiency while maintaining competitive task performance.
Sources
- Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments
- UI-TARS: Pioneering Automated GUI Interaction with Native Agents
- AndroidEnv: A Reinforcement Learning Platform for Android
- Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception
- MobileAgentBench: An Efficient and User-Friendly Benchmark for Mobile LLM Agents
- Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Tasks
- Hi-Agent: Hierarchical Vision-Language Agents for Mobile Device Control
- OS-ATLAS: A Foundation Action Model for Generalist GUI Agents
- Understanding the Weakness of Large Language Model Agents within a Complex Android Environment
- Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agents
- Mobile-Bench-v2: A More Realistic and Comprehensive Benchmark for VLM-based Mobile Agents
- Mobile-Agent-v3: Fundamental Agents for GUI Automation
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems