GUI-explorer: Autonomous Exploration and Mining of Transition-aware Knowledge for GUI Agent

Bin Xie , Rui Shao , Gongwei Chen , Kaiwen Zhou , Yinchuan Li , Jie Liu , Min Zhang , Liqiang Nie

🏛 Institutions: HIT-Shenzhen , Huawei Noah's Ark Lab
📅 Date: May 22, 2025
📑 Publisher: ACL 2025
💻 Env: Mobile
🔑 Keywords: training-free framework benchmark autonomous exploration transition-aware knowledge GUI-KRB GUI-explorer

TLDR

GUI-explorer is a training-free mobile GUI agent that automatically explores app functionality and mines transition-aware knowledge from observed state changes. It also introduces the GUI-KRB benchmark for mobile GUI reasoning, and shows strong gains on SPA-Bench and AndroidWorld without parameter updates for new apps.

Open paper Report issue