IGG: A Benchmark for Interactive GUI Grounding under Visibility Constraints

IGG benchmarks interactive GUI grounding under partial visibility, requiring agents to actively explore, scroll, and reveal non-visible controls rather than assuming all elements are on screen.

• PointerBench: A Diagnostic Benchmark for Fine-Grained GUI Grounding
  October 22, 2026 · arXiv
• ScreenHaystack: Finding Blind Zones in GUI Grounding
  September 25, 2026 · EMNLP 2026
• GUI-Perturbed: Domain Randomization Reveals Systematic Brittleness in GUI Grounding Models
  April 15, 2026 · arXiv
• What's Missing in Screen-to-Action? Towards a UI-in-the-Loop Paradigm for Multimodal GUI Reasoning
  April 8, 2026 · Findings of ACL 2026
• Beyond Clicking: A Step Towards Generalist GUI Grounding via Text Dragging
  November 7, 2025 · arXiv
• Scaling Computer‑Use Grounding via User Interface Decomposition and Synthesis
  May 19, 2025 · NeurIPS 2025 Datasets and Benchmarks Track (Spotlight)
• UI-E2I-Synth: Advancing GUI Grounding with Large-Scale Instruction Synthesis
  April 15, 2025 · Findings of ACL 2025
• VenusBench-GD: A Comprehensive Multi-Platform GUI Benchmark for Diverse Grounding Tasks
  December 18, 2025 · arXiv
• ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use
  April 4, 2025 · ACM Multimedia 2025
• SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents
  January 17, 2024 · ACL 2024
• Right Click, Wrong Box: Grading GUI Grounding by What a Click Does
  October 27, 2026 · arXiv
• Learning to Look Beyond Screens: Transferable Visual Observation from GUI Grounding
  October 27, 2026 · arXiv
• AdaGround: Token-Normalized Adaptive Zooming with Verifier-in-the-Loop Refinement for GUI Grounding
  October 27, 2026 · arXiv
• PreView: Enhancing GUI Grounding with Preprocessed Views and Cues
  October 24, 2026 · arXiv
• Beyond Next-Screen Prediction: The Decision Value of GUI World Models
  October 17, 2026 · arXiv
• MMA-SafetyBench: A Benchmark for Multimodal Agent Safety Evaluation
  October 14, 2026 · arXiv
• GroundGUI: GUI Grounding by High-Quality Data and Distillation-to-Reinforcement Learning
  October 13, 2026 · arXiv
• cua-speedrun: Standardized Benchmarking of the Speed of Computer-Use Agents
  September 30, 2026 · arXiv
• SCA: Spatial Credit Assignment for Reinforcement Learning of GUI Agents
  September 29, 2026 · arXiv
• PrecogUI: Proactive GUI Agents via Pre-cognitive Simulation and Experience Retrieval
  September 29, 2026 · arXiv
• LongPuzzleBench: Evaluating GUI Agents on Long-Horizon Visual Puzzles
  September 28, 2026 · arXiv
• The GUI Is Not the State: Diagnosing State Aliasing in GUI World Models
  September 26, 2026 · arXiv
• How Many Pixels Is a Digit Worth? Place-Aware Coordinate Entropy for GUI Agent Confidence Estimation
  September 21, 2026 · EMNLP 2026
• RankGround: Efficient High-Resolution GUI Grounding via Lightweight Reranker-Guided Crop Selection
  September 16, 2026 · ACM MM 2026