Selective Knowledge Control for Continual GUI Agent Learning over Application Streams
cs.CV, cs.AI
Submitted: 2026-09-06
Updated: 2026-09-06
Project page: https://shzirui.github.io/SKC
Sources
- GUICourse: From General Vision Language Models to Versatile GUI Agents
- Orthogonal Gradient Descent for Continual Learning
- Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents
- A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesis
- WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models
- LoRA: Low-Rank Adaptation of Large Language Models
- ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use
- Efficient Multi-turn RL for GUI Agents via Decoupled Training and Adaptive Data Curation
- GUI-AC: Enhancing Continual Learning in GUI Agents
- ShowUI: One Vision-Language-Action Model for GUI Visual Agent
- Continual GUI Agents
- GUIOdyssey: A Comprehensive Dataset for Cross-App GUI Navigation on Mobile Devices
- OmniParser for Pure Vision Based GUI Agent
- UI-Vision: A Desktop-centric GUI Benchmark for Visual Perception and Interaction
- Synatra: Turning Indirect Knowledge into Direct Demonstrations for Digital Agents at Scale
- Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents
- UI-TARS: Pioneering Automated GUI Interaction with Native Agents
- AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agents
- Interactive Reward Agent: GUI Task Evaluation via Environment-State Verification
- GUI Knowledge Bench: Revealing the Knowledge Gap of VLMs in GUI Tasks
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models