Continual GUI Agents
Ziwei Liu , Borui Kang , Hangjie Yuan , Zixiang Zhao , Wei Li , Yifan Zhu , Tao Feng
- 🏛 Institutions
- Tsinghua , ZJU , ETH , Beijing University of Posts and Telecommunications
- 📅 Date
- January 28, 2026
- 📑 Publisher
- arXiv
- 💻 Env
- General GUI
- 🔑 Keywords
TLDR
This paper defines continual GUI agents as agents that must keep grounding accurately while interface domains and resolutions shift over time. It introduces GUI-AiF, a reinforcement fine-tuning method with anchoring-point and anchoring-region rewards, and reports stronger continual-domain and continual-resolution performance than prior baselines.
Related papers (24)
- Selective Knowledge Control for Continual GUI Agent Learning over Application StreamsSeptember 6, 2026 · arXiv
- CGL: Advancing Continual GUI Learning via Reinforcement Fine-TuningMarch 3, 2026 · arXiv
- Autonomous Continual Learning of Computer-Use Agents for Environment AdaptationFebruary 10, 2026 · arXiv
- Agent-Dice: Disentangling Knowledge Updates via Geometric Consensus for Agent Continual LearningJanuary 7, 2026 · arXiv
- One Rollout Is All You Get: Fully Test-Time Adaptation for GUI AgentsSeptember 28, 2026 · arXiv
- PolySkill: Learning Generalizable Skills Through Polymorphic AbstractionOctober 17, 2025 · arXiv
- UI-Venus Technical Report: Building High-performance UI Agents with RFTAugust 14, 2025 · arXiv
- GuirlVG: Incentivize GUI Visual Grounding via Empirical Exploration on Reinforcement LearningAugust 6, 2025 · ICLR 2026 (Poster)
- Where to Learn and How Far to Roll Out: Efficient Adaptive Training for GUI AgentsOctober 29, 2026 · arXiv
- Right Click, Wrong Box: Grading GUI Grounding by What a Click DoesOctober 27, 2026 · arXiv
- Learning to Look Beyond Screens: Transferable Visual Observation from GUI GroundingOctober 27, 2026 · arXiv
- From Interaction to Capability: Task Advancement as State and Supervision for GUI AgentsOctober 27, 2026 · arXiv
- AdaGround: Token-Normalized Adaptive Zooming with Verifier-in-the-Loop Refinement for GUI GroundingOctober 27, 2026 · arXiv
- GUIFlow: Temporal Redundancy-Aware Incremental Inference for GUI AgentsOctober 26, 2026 · arXiv
- PreView: Enhancing GUI Grounding with Preprocessed Views and CuesOctober 24, 2026 · arXiv
- Build or Adopt? Custom-Built vs. General-Purpose LLM Agent Harnesses for Automotive GUI TestingOctober 24, 2026 · arXiv
- IGG: A Benchmark for Interactive GUI Grounding under Visibility ConstraintsOctober 23, 2026 · arXiv
- Correct Answers, Closed Gates: SolveBind for GUI Agents at the Verification BarrierOctober 23, 2026 · arXiv
- Trace2World: Reconstructing App Worlds from Real Interaction Traces for Scalable GUI Agent TrainingOctober 22, 2026 · arXiv
- PointerBench: A Diagnostic Benchmark for Fine-Grained GUI GroundingOctober 22, 2026 · arXiv
- Who Verifies the Agent's Success Claim? Self-Report Leakage in GUI-Agent Completion JudgingOctober 21, 2026 · arXiv
- Lost in Recovery: Demystifying Recovery Behavior of Computer-Use Agents via Goal-Oriented Action ReplayOctober 20, 2026 · arXiv
- ScopeMem: Latent Memory That Learns Where to Revise Frozen GUI AgentsOctober 19, 2026 · arXiv
- Focused Omni-Modal GUI AgentsOctober 19, 2026 · arXiv