GroundGUI: GUI Grounding by High-Quality Data and Distillation-to-Reinforcement Learning

Introduces ScreenRef, a high-quality multi-platform GUI referring expression dataset, and GroundGUI, an agent trained via distillation from large VLMs followed by reinforcement learning, achieving superior grounding accuracy across desktop, web, and mobile environments.

• SCA: Spatial Credit Assignment for Reinforcement Learning of GUI Agents
  September 29, 2026 · arXiv
• GUI-C²: Coarse-to-Fine GUI Grounding via Difficulty-Aware Reinforcement Learning
  May 29, 2026 · arXiv
• LiteGUI: Distilling Compact GUI Agents with Reinforcement Learning
  May 8, 2026 · arXiv
• Moving Beyond Sparse Grounding with Complete Screen Parsing Supervision
  February 15, 2026 · arXiv
• SSL: Sweet Spot Learning for Differentiated Guidance in Agentic Optimization
  January 30, 2026 · arXiv
• Beyond Clicking: A Step Towards Generalist GUI Grounding via Text Dragging
  November 7, 2025 · arXiv
• UI-AGILE: Advancing GUI Agents with Effective Reinforcement Learning and Precise Inference-Time Grounding
  July 29, 2025 · CVPR 2026 Findings
• GUI-G1: Understanding R1-Zero-Like Training for Visual Grounding in GUI Agents
  May 21, 2025 · NeurIPS 2025 (Poster)
• Scaling Computer‑Use Grounding via User Interface Decomposition and Synthesis
  May 19, 2025 · NeurIPS 2025 Datasets and Benchmarks Track (Spotlight)
• Enhancing Visual Grounding for GUI Agents via Self-Evolutionary Reinforcement Learning
  May 18, 2025 · NeurIPS 2025 (Poster)
• UI-E2I-Synth: Advancing GUI Grounding with Large-Scale Instruction Synthesis
  April 15, 2025 · Findings of ACL 2025
• EDGE: Enhanced Grounded GUI Understanding with Enriched Multi-Granularity Synthetic Data
  October 25, 2024 · arXiv
• OmniParser for Pure Vision Based GUI Agent
  August 1, 2024 · arXiv
• DeskForge: Dense Supervision from Desktop Environments for Computer-Use Agents
  October 1, 2026 · arXiv
• HybridCUA: Learning to Orchestrate GUI and CLI for Computer-Use Agents
  September 29, 2026 · arXiv
• CaptchaArena: A Large-Scale, Fine-Grained Dataset for Training Computer-Use Agents on Interactive CAPTCHAs
  September 25, 2026 · arXiv
• MintAct: A Unified Visual Agent for Digital Environments
  September 18, 2026 · arXiv
• WebArena-Infinity: Generating Browser Environments with Verifiable Tasks at Scale
  March 2026 · Blog Post
• UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning
  March 27, 2025 · arXiv
• OS-ATLAS: A Foundation Action Model for Generalist GUI Agents
  October 30, 2024 · ICLR 2025 (Spotlight)
• Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents
  October 7, 2024 · ICLR 2025 (Oral)
• MobileViews: A Million-scale and Diverse Mobile GUI Dataset
  September 22, 2024 · arXiv
• SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents
  January 17, 2024 · ACL 2024
• Where to Learn and How Far to Roll Out: Efficient Adaptive Training for GUI Agents
  October 29, 2026 · arXiv