GUI-C²: Coarse-to-Fine GUI Grounding via Difficulty-Aware Reinforcement Learning

Junlong Li , Chao Hao , Lap-Pui Chau , Yi Wang

🏛 Institutions: PolyU
📅 Date: May 29, 2026
📑 Publisher: arXiv
💻 Env: General GUI
🔑 Keywords: GUI grounding reinforcement learning difficulty-aware data curation coarse-to-fine refinement GUI-C²

TLDR

GUI-C² targets data efficiency and inference overhead in RL-based GUI grounding by combining GUI-D, a difficulty-scored data curation pipeline, with area-gated coarse-to-fine visual refinement. Its improvement-aware stage rewards and simplified decision process achieve 46.4% on ScreenSpot-Pro with a 3B model while adding minimal inference time.

Open paper arXiv Code Dataset Report issue