ConClick: Element-Wise Contrastive Learning Improves GUI Grounding

Ruotian Zhang , Yuhui Zhang , Junzhe Huang , Yu Xin , Hehe Fan , Xiaoxiao Sun

🏛 Institutions: Independent Researcher
📅 Date: October 9, 2026
📑 Publisher: arXiv
💻 Env: Mobile Web
🔑 Keywords: ConClick ReClick GUI grounding contrastive learning ScreenSpot-Pro OSWorld-G

TLDR

Analyzes GUI grounding error patterns and identifies that incorrect clicks predominantly land on plausible distractor elements rather than background. Proposes ConClick, a contrastive learning framework trained on 4,292 target-distractor pairs, improving Qwen3-VL-8B grounding accuracy from 54.7% to 66.0% on ScreenSpot-Pro and from 63.3% to 70.2% on OSWorld-G.

Open paper Code Report issue