GUI-AIMA: Aligning Intrinsic Multimodal Attention with a Context Anchor for GUI Grounding

Shijie Zhou , Viet Dac Lai , Hao Tan , Jihyung Kil , Wanrong Zhu , Changyou Chen , Ruiyi Zhang

🏛 Institutions: State University of New York at Buffalo , Adobe Research
📅 Date: November 2, 2025
📑 Publisher: ECCV 2026
💻 Env: General GUI
🔑 Keywords: GUI-AIMA model GUI grounding attention coordinate-free ScreenSpot-Pro OSWorld-G

TLDR

GUI-AIMA is an attention-based, coordinate-free supervised fine-tuning framework for GUI grounding that aligns the intrinsic multimodal attention of an MLLM with patch-wise grounding signals and supports a plug-and-play zoom-in stage. GUI-AIMA-3B, trained on about 101k screenshots, reaches 61.5% on ScreenSpot-Pro and 68.1% on OSWorld-G.

Open paper Publisher Code Report issue