ReGUIDE: Data Efficient GUI Grounding via Spatial Reasoning and Search

ReGUIDE improves web GUI grounding under limited data by combining self-generated reasoning, spatially aware criticism, and test-time spatial search. It substantially outperforms baselines while using only a tiny fraction of the training data required by prior web-grounding approaches.

• GUI-Primitives: Diagnosing Spatial Reasoning Failures in Vision-Language GUI Grounding
  August 22, 2026 · arXiv
• Zoom in, Click out: Unlocking and Evaluating the Potential of Zooming for GUI Grounding
  December 5, 2025 · arXiv
• STP-GUI: Spatially-Aware Token Pruning for Efficient Web-GUI Agents
  October 14, 2026 · arXiv
• MHVF: Training-Free GUI Grounding via Verification-Guided Multi-Hypothesis Search
  October 13, 2026 · arXiv
• Seg2Click: Learning Pixel-Level Action Masks for GUI Visual Grounding
  October 12, 2026 · arXiv
• ConClick: Element-Wise Contrastive Learning Improves GUI Grounding
  October 9, 2026 · arXiv
• Imagine to Act: High-Fidelity Data Synthesis via Image Editing World Model for Scalable GUI Agent Training
  October 5, 2026 · arXiv
• CLIFT: Conformal Self-Verification for Web Agent Training and Test-Time Scaling
  October 5, 2026 · arXiv
• Recurrent Latent Visual Search for GUI Grounding
  October 4, 2026 · arXiv
• MintAct: A Unified Visual Agent for Digital Environments
  September 18, 2026 · arXiv
• Lexical Coupling in GUI Element Grounding: Sentence Embeddings Track Labels across Mobile and Web
  August 22, 2026 · arXiv
• OpeFlo: Automated UX Evaluation via Simulated Human Web Interaction with GUI Grounding
  February 25, 2026 · arXiv
• WebTestPilot: Agentic End-to-End Web Testing against Natural Language Specification by Inferring Oracles with Symbolized GUI Elements
  February 12, 2026 · arXiv
• Agentic Test-Time Scaling for WebAgents
  February 12, 2026 · arXiv
• VenusBench-GD: A Comprehensive Multi-Platform GUI Benchmark for Diverse Grounding Tasks
  December 18, 2025 · arXiv
• Test‑Time Reinforcement Learning for GUI Grounding via Region Consistency
  August 7, 2025 · AAAI 2026
• WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learning
  May 22, 2025 · EMNLP 2025 (Poster)
• ScaleTrack: Scaling and back-tracking Automated GUI Agents
  May 1, 2025 · arXiv
• GUI-R1: A Generalist R1-Style Vision-Language Action Model for GUI Agents
  April 14, 2025 · arXiv
• UI-TARS: Pioneering Automated GUI Interaction with Native Agents
  January 21, 2025 · arXiv
• Iris: Breaking GUI Complexity with Adaptive Focus and Self-Refining
  December 13, 2024 · arXiv
• Ponder & Press: Advancing Visual GUI Agent towards General Computer Control
  December 2, 2024 · Findings of ACL 2025
• Improved GUI Grounding via Iterative Narrowing
  November 18, 2024 · arXiv
• OS-ATLAS: A Foundation Action Model for Generalist GUI Agents
  October 30, 2024 · ICLR 2025 (Spotlight)