Improved GUI Grounding via Iterative Narrowing

Iterative Narrowing is a visual-prompting framework for GUI grounding that repeatedly zooms into smaller image regions to refine predictions. The paper shows that this simple test-time strategy improves both general and fine-tuned VLMs on one-shot grounding across multiple UI platforms.

• VenusBench-GD: A Comprehensive Multi-Platform GUI Benchmark for Diverse Grounding Tasks
  December 18, 2025 · arXiv
• ScaleTrack: Scaling and back-tracking Automated GUI Agents
  May 1, 2025 · arXiv
• UI-TARS: Pioneering Automated GUI Interaction with Native Agents
  January 21, 2025 · arXiv
• Ponder & Press: Advancing Visual GUI Agent towards General Computer Control
  December 2, 2024 · Findings of ACL 2025
• OS-ATLAS: A Foundation Action Model for Generalist GUI Agents
  October 30, 2024 · ICLR 2025 (Spotlight)
• TinyClick: Single-Turn Agent for Empowering GUI Automation
  October 9, 2024 · INTERSPEECH 2025
• Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents
  October 7, 2024 · ICLR 2025 (Oral)
• SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents
  January 17, 2024 · ACL 2024
• UI-Zoomer: Uncertainty-Driven Adaptive Zoom-In for GUI Grounding
  April 15, 2026 · arXiv
• Zoom to Essence: Trainless GUI Grounding by Inferring upon Interface Elements
  March 15, 2026 · arXiv
• Trifuse: Enhancing Attention-Based GUI Grounding via Multimodal Fusion
  February 6, 2026 · arXiv
• MVP: Multiple View Prediction Improves GUI Grounding
  December 9, 2025 · arXiv
• Zoom in, Click out: Unlocking and Evaluating the Potential of Zooming for GUI Grounding
  December 5, 2025 · arXiv
• Iris: Breaking GUI Complexity with Adaptive Focus and Self-Refining
  December 13, 2024 · arXiv
• GPA: Learning GUI Process Automation from Demonstrations
  April 2, 2026 · arXiv
• GUIDE: Resolving Domain Bias in GUI Agents through Real-Time Web Video Retrieval and Plug-and-Play Annotation
  March 27, 2026 · arXiv
• M^2: Dual-Memory Augmentation for Long-Horizon Web Agents via Trajectory Summarization and Insight Retrieval
  February 28, 2026 · arXiv
• OpeFlo: Automated UX Evaluation via Simulated Human Web Interaction with GUI Grounding
  February 25, 2026 · arXiv
• Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agents
  February 15, 2026 · arXiv
• WebTestPilot: Agentic End-to-End Web Testing against Natural Language Specification by Inferring Oracles with Symbolized GUI Elements
  February 12, 2026 · arXiv
• OS-Oracle: A Comprehensive Framework for Cross-Platform GUI Critic Models
  December 18, 2025 · arXiv
• AFRAgent : An Adaptive Feature Renormalization Based High Resolution Aware GUI agent
  November 30, 2025 · WACV 2026
• WebATLAS: An LLM Agent with Experience-Driven Memory and Action Simulation
  October 26, 2025 · NeurIPS 2025 Workshop on Language Agents and World Models
• Surfer 2: The Next Generation of Cross-Platform Computer Use Agents
  October 22, 2025 · arXiv