Reinforcement Learning in GUI Agents: A Survey Toward Digital Inhabitants
cs.AI, cs.CV
Submitted: 2026-04-30
Updated: 2026-11-04
Terminology
Sources
- GPT-4 Technical Report
- Automated Reinforcement Learning: An Overview
- Agent S: An Open Agentic Framework that Uses Computers Like a Human
- Agent S2: A Compositional Generalist-Specialist Framework for Computer Use Agents
- Agent-X: Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks
- Digi-Q: Learning Q-Value Functions for Training Device-Control Agents
- Qwen3-VL Technical Report
- Constitutional AI: Harmlessness from AI Feedback
- Terminal Agents Suffice for Enterprise Automation
- Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale
- SmartSnap: Proactive Evidence Seeking for Self-Verifying Agents
- GUI-Eyes: Tool-Augmented Perception for Visual Grounding in GUI Agents
- AgentCPM-Explore: Realizing Long-Horizon Deep Exploration for Edge-Scale Agents
- Unify-Agent: A Unified Multimodal Agent for World-Grounded Image Synthesis
- Scaling Agent Learning via Experience Synthesis
- MGA: Memory-Driven GUI Agent for Observation-Centric Interaction
- ELMUR: External Layer Memory with Update/Rewrite for Long-Horizon RL Problems
- The BrowserGym Ecosystem for Web Agent Research
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
- Agentic Reward Modeling: Verifying GUI Agent via Progressive Trajectory-Grounded Interaction
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents