SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents

SeeClick is a screenshot-only GUI agent built around the GUI grounding problem rather than structured trees such as HTML. The paper adds automated GUI-grounding data curation and introduces ScreenSpot, a grounding benchmark spanning mobile, desktop, and web environments.

• RecreationWorld: Scalable and Verifiable Environments for Hybrid Computer-Use Agents
  September 18, 2026 · arXiv
• VenusBench-GD: A Comprehensive Multi-Platform GUI Benchmark for Diverse Grounding Tasks
  December 18, 2025 · arXiv
• Ponder & Press: Advancing Visual GUI Agent towards General Computer Control
  December 2, 2024 · Findings of ACL 2025
• OS-ATLAS: A Foundation Action Model for Generalist GUI Agents
  October 30, 2024 · ICLR 2025 (Spotlight)
• TinyClick: Single-Turn Agent for Empowering GUI Automation
  October 9, 2024 · INTERSPEECH 2025
• Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents
  October 7, 2024 · ICLR 2025 (Oral)
• GUI-World: A Video Benchmark and Dataset for Multimodal GUI-oriented Understanding
  June 16, 2024 · ICLR 2025 (Poster)
• Recurrent Latent Visual Search for GUI Grounding
  October 4, 2026 · arXiv
• Beyond Clicking: A Step Towards Generalist GUI Grounding via Text Dragging
  November 7, 2025 · arXiv
• NaturalGAIA: Pushing the Frontiers of GUI Agents with a Challenging Benchmark and High-Quality Trajectory Dataset
  August 2, 2025 · arXiv
• Scaling Computer‑Use Grounding via User Interface Decomposition and Synthesis
  May 19, 2025 · NeurIPS 2025 Datasets and Benchmarks Track (Spotlight)
• UI-E2I-Synth: Advancing GUI Grounding with Large-Scale Instruction Synthesis
  April 15, 2025 · Findings of ACL 2025
• GUI Action Narrator: Where and When Did That Action Take Place?
  June 19, 2024 · arXiv
• OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Web
  February 29, 2024 · ECCV 2024 (Poster)
• Imagine to Act: High-Fidelity Data Synthesis via Image Editing World Model for Scalable GUI Agent Training
  October 5, 2026 · arXiv
• DeskForge: Dense Supervision from Desktop Environments for Computer-Use Agents
  October 1, 2026 · arXiv
• MintAct: A Unified Visual Agent for Digital Environments
  September 18, 2026 · arXiv
• PriMobiBench: Characterizing Visual Privacy Leakage in VLM-Driven Mobile GUI Agents
  September 12, 2026 · arXiv
• OSReward: Instituting Standardized Evaluation for Cross-Platform Computer-Use Reward Models
  July 30, 2026 · arXiv
• Scaling, Benchmarking, and Reasoning of Vision-Language Agents for Mobile GUI Navigation
  May 26, 2026 · ICML 2026 (Poster)
• WebForge: Breaking the Realism-Reproducibility-Scalability Trilemma in Browser Agent Benchmark
  April 13, 2026 · arXiv
• Gym-Anything: Turn any Software into an Agent Environment
  April 7, 2026 · arXiv
• WebArena-Infinity: Generating Browser Environments with Verifiable Tasks at Scale
  March 2026 · Blog Post
• PSPA-Bench: A Personalized Benchmark for Smartphone GUI Agent
  March 31, 2026 · arXiv