RankGround: Efficient High-Resolution GUI Grounding via Lightweight Reranker-Guided Crop Selection

Liyang Fan , Xinping Bi , Yitai Li , Shuaimin Li , Hui Li , Min Yang

🏛 Institutions: Shenzhen University , Shenzhen University of Advanced Technology , Shenzhen Institutes of Advanced Technology , CAS
📅 Date: September 16, 2026
📑 Publisher: ACM MM 2026
💻 Env: General GUI
🔑 Keywords: RankGround GroundRanker GUI grounding reranking crop selection

TLDR

RankGround achieves high-resolution GUI grounding with a single VLM call per query by first using GroundRanker, a lightweight multimodal reranker, to pick the most promising crop from a dense candidate set. Ranking supervision is constructed from existing grounding datasets under a strict containment criterion and trained with a pointwise-then-listwise curriculum, yielding 1.4x faster inference and 5.5% average accuracy gains over the second-best method across backbones and screen scales.

Open paper Report issue