AdaZoom-GUI: Adaptive Zoom-based GUI Grounding with Instruction Refinement

AdaZoom-GUI targets two concrete GUI-grounding bottlenecks: ambiguous natural-language instructions and tiny UI elements in high-resolution screenshots. It combines instruction rewriting with a conditional second-stage zoom-in pass and reports state-of-the-art grounding performance among comparable model sizes.

• UI-Zoomer: Uncertainty-Driven Adaptive Zoom-In for GUI Grounding
  April 15, 2026 · arXiv
• Towards GUI Agents: Vision-Language Diffusion Models for GUI Grounding
  March 27, 2026 · CVPR 2026
• GUI-C²: Coarse-to-Fine GUI Grounding via Difficulty-Aware Reinforcement Learning
  May 29, 2026 · arXiv
• GUI-Perturbed: Domain Randomization Reveals Systematic Brittleness in GUI Grounding Models
  April 15, 2026 · arXiv
• See, Point, Refine: Multi-Turn Approach to GUI Grounding with Visual Feedback
  April 14, 2026 · arXiv
• What's Missing in Screen-to-Action? Towards a UI-in-the-Loop Paradigm for Multimodal GUI Reasoning
  April 8, 2026 · Findings of ACL 2026
• Zoom to Essence: Trainless GUI Grounding by Inferring upon Interface Elements
  March 15, 2026 · arXiv
• CGL: Advancing Continual GUI Learning via Reinforcement Fine-Tuning
  March 3, 2026 · arXiv
• Moving Beyond Sparse Grounding with Complete Screen Parsing Supervision
  February 15, 2026 · arXiv
• Trifuse: Enhancing Attention-Based GUI Grounding via Multimodal Fusion
  February 6, 2026 · arXiv
• POINTS-GUI-G: GUI-Grounding Journey
  February 6, 2026 · arXiv
• SSL: Sweet Spot Learning for Differentiated Guidance in Agentic Optimization
  January 30, 2026 · arXiv
• V2P: Visual Attention Calibration for GUI Grounding via Background Suppression and Center Peaking
  January 11, 2026 · arXiv
• MVP: Multiple View Prediction Improves GUI Grounding
  December 9, 2025 · arXiv
• Zoom in, Click out: Unlocking and Evaluating the Potential of Zooming for GUI Grounding
  December 5, 2025 · arXiv
• Beyond Clicking: A Step Towards Generalist GUI Grounding via Text Dragging
  November 7, 2025 · arXiv
• GUI-Spotlight: Adaptive Iterative Focus Refinement for Enhanced GUI Visual Grounding
  October 5, 2025 · arXiv
• UI-AGILE: Advancing GUI Agents with Effective Reinforcement Learning and Precise Inference-Time Grounding
  July 29, 2025 · CVPR 2026 Findings
• GUI-G1: Understanding R1-Zero-Like Training for Visual Grounding in GUI Agents
  May 21, 2025 · NeurIPS 2025 (Poster)
• Scaling Computer‑Use Grounding via User Interface Decomposition and Synthesis
  May 19, 2025 · NeurIPS 2025 Datasets and Benchmarks Track (Spotlight)
• Enhancing Visual Grounding for GUI Agents via Self-Evolutionary Reinforcement Learning
  May 18, 2025 · NeurIPS 2025 (Poster)
• Visual Test-time Scaling for GUI Agent Grounding
  May 1, 2025 · ICCV 2025
• UI-E2I-Synth: Advancing GUI Grounding with Large-Scale Instruction Synthesis
  April 15, 2025 · Findings of ACL 2025
• Think Twice, Click Once: Enhancing GUI Grounding via Fast and Slow Systems
  March 9, 2025 · arXiv