UI-Mem: Self-Evolving Experience Memory for Online Reinforcement Learning in Mobile GUI Agents

Han Xiao , Guozhi Wang , Hao Wang , Shilong Liu , Yuxiang Chai , Yue Pan , Yufeng Zhou , Xiaoxin Chen , Yafei Wen , Hongsheng Li

🏛 Institutions: Multimedia Laboratory (MMLab) , CUHK , vivo AI Lab , Princeton , Shenzhen Loop Area Institute , Shanghai AI Laboratory
📅 Date: February 5, 2026
📑 Publisher: arXiv
💻 Env: Mobile
🔑 Keywords: memory reinforcement learning online RL hierarchical experience memory stratified group sampling UI-Mem

TLDR

UI-Mem augments online RL for mobile GUI agents with a hierarchical experience memory that stores reusable workflows, subtask skills, and failure patterns as transferable templates. Its stratified group sampling lets the policy absorb memory-informed behavior and improves over standard online RL baselines.

Open paper arXiv Report issue