GUI Agents Papers
Star · 921

PhoneCLI: From App Interfaces to Callable Commands for Mobile Agents

Yangqin Jiang , Lingrui Xu , Chao Huang

🏛 Institutions
HKU
📅 Date
September 28, 2026
📑 Publisher
arXiv
💻 Env
Mobile
🔑 Keywords
PhoneCLIcompilationefficiencyAndroidLabAndroidWorldtraining-free
TLDR

PhoneCLI compiles a mobile app's GUI navigation into callable commands by exploring the app offline into an annotated screen map; online, the agent verifies and replays a command deterministically and falls back to the VLM for open-ended interaction. It needs no app-internal API or training and improves success while cutting steps and tokens on AndroidLab.

Open paper Code Report issue
Related papers (24)