UI-Genie: A Self-Improving Approach for Iteratively Boosting MLLM-based Mobile GUI Agents

Han Xiao , Guozhi Wang , Yuxiang Chai , Zimu Lu , Weifeng Lin , Hao He , Lue Fan , Liuyang Bian , Rui Hu , Liang Liu , Shuai Ren , Yafei Wen , Xiaoxin Chen , Aojun Zhou , Hongsheng Li

🏛 Institutions: CUHK MMLab , vivo AI Lab , CPII under InnoHK
📅 Date: May 27, 2025
📑 Publisher: NeurIPS 2025 (Poster)
💻 Env: Mobile
🔑 Keywords: model dataset reward model self-improvement outcome verification UI-Genie

TLDR

UI-Genie targets two mobile-agent bottlenecks: reliable outcome verification and scalable high-quality training data. It combines an interleaved reward model with a reward-guided self-improvement loop, releases reward-specific GUI datasets, and reports stronger mobile-agent performance across multiple rounds of self-improvement.

Open paper arXiv Report issue