Same Tasks, Different Apps: Why Mobile GUI Agents Fail to Generalize?

Tien Tran , Namho Koh , Daiki E. Matsunaga , Ayush Jain , Kee Eung Kim

🏛 Institutions: KAIST , CMU
📅 Date: September 28, 2026
📑 Publisher: Findings of EMNLP 2026
💻 Env: Mobile
🔑 Keywords: AnyAppBench benchmark cross-application generalization failure analysis Android

TLDR

AnyAppBench is a live Android benchmark with 100 task templates and 520 task-application pairs over 52 applications that keeps the user goal fixed across apps. Across 13 agents, success on the original application does not transfer reliably to new applications with the same goal, and sub-goal decomposition does not close the gap.

Open paper arXiv Report issue