MHVF: Training-Free GUI Grounding via Verification-Guided Multi-Hypothesis Search
Minghua Chen , Xingming Liao , Weiqiang Zhong , Zhuowei Wang
- 🏛 Institutions
- Guangdong University of Technology
- 📅 Date
- October 13, 2026
- 📑 Publisher
- arXiv
- 💻 Env
- Web
- 🔑 Keywords
TLDR
Proposes Multi-Hypothesis Verification and Filtering (MHVF), a training-free inference framework that generates diverse candidate click points and filters them through bidirectional verification between instruction intent and visual context. MHVF achieves substantial grounding accuracy gains on WebVoyager and ScreenSpot without additional model fine-tuning.
Related papers (24)
- STP-GUI: Spatially-Aware Token Pruning for Efficient Web-GUI AgentsOctober 14, 2026 · arXiv
- Improved GUI Grounding via Iterative NarrowingNovember 18, 2024 · arXiv
- UI-Zoomer: Uncertainty-Driven Adaptive Zoom-In for GUI GroundingApril 15, 2026 · arXiv
- Zoom to Essence: Trainless GUI Grounding by Inferring upon Interface ElementsMarch 15, 2026 · arXiv
- Trifuse: Enhancing Attention-Based GUI Grounding via Multimodal FusionFebruary 6, 2026 · arXiv
- MVP: Multiple View Prediction Improves GUI GroundingDecember 9, 2025 · arXiv
- Zoom in, Click out: Unlocking and Evaluating the Potential of Zooming for GUI GroundingDecember 5, 2025 · arXiv
- InterA11y: Interactive Web Accessibility Error Detection with LLM AgentsOctober 29, 2026 · arXiv
- AgentHeal: Evaluating Goal-Preserving Resource Recovery of Web Agents under Access BarriersOctober 29, 2026 · arXiv
- WebAnything: From the Wild Web to Scalable Agent EnvironmentsOctober 27, 2026 · arXiv
- SkillLifeBench: Benchmarking Security Across the Lifecycle of Agent SkillsOctober 26, 2026 · arXiv
- Back to Basics: A Skill-Centric Approach to Generalist Web AgentsOctober 26, 2026 · arXiv
- AgentProofBench: Benchmarking Reusable Verifiers for Web AgentsOctober 25, 2026 · arXiv
- SkillShift-Bench: Benchmarking Skill Learning under Environment Evolution for Web AgentsOctober 24, 2026 · arXiv
- Learning What to Ask for Tomorrow: Active Preference Acquisition for Long-Term Personalized Web AgentsOctober 22, 2026 · arXiv
- Step-Aligned Script Generation with Verification and Recovery for Web Automation TestingOctober 19, 2026 · arXiv
- LoWAgent: A Low-Resource Multilingual Benchmark for Web AgentsOctober 19, 2026 · arXiv
- Why Generate a Click? Plug-in Decision Heads for Web AgentsOctober 14, 2026 · arXiv
- Teaching Agents in their Own Style: Blackbox Teacher Distillation for Web AgentsOctober 14, 2026 · arXiv
- Seg2Click: Learning Pixel-Level Action Masks for GUI Visual GroundingOctober 12, 2026 · arXiv
- When Charts Deceive Web Agents: A Paired Benchmark for Misleading Visualization-Grounded TasksOctober 9, 2026 · arXiv
- Web$hell: A Unified Interface for Agentic Web AccessOctober 9, 2026 · arXiv
- ConClick: Element-Wise Contrastive Learning Improves GUI GroundingOctober 9, 2026 · arXiv
- Adversarial Images Hijack Web Agents from Visual Grounding to Browser ExecutionOctober 7, 2026 · arXiv