ScaleWoB: Guiding GUI Agents with Coding Agents via Large-Scale Environmental Synthesis

Guohong Liu , Jialei Ye , Pengzhi Gao , Wei Liu , Jian Luan , Yunxin Liu , Yuanchun Li

🏛 Institutions: AIR, Tsinghua , University of Electronic Science and Technology of China , MiLM Plus , Xiaomi
📅 Date: May 24, 2026
📑 Publisher: arXiv
💻 Env: Mobile
🔑 Keywords: framework benchmark environment synthesis verifiable rewards long-horizon tasks ScaleWoB

TLDR

ScaleWoB uses coding agents to synthesize high-fidelity, backend-free interactive environments with verifiable rewards for GUI-agent evaluation and training across mobile, desktop, and automotive interfaces. Its release covers more than 100 environments and 1,000 tasks, including a 120-task mobile benchmark where current agents average 27.92% success and only 17.82% on long-horizon tasks, compared with 92.08% for humans.

Open paper arXiv Code Report issue