RecreationWorld: Scalable and Verifiable Environments for Hybrid Computer-Use Agents

Shuai Bai , Jiayong Deng , Yikun Fu , Chang Gao , Xuhao Hu , Mianqiu Huang , Yizhen Jiang , Yuheng Jing , Dehui Kong , Keliang Li , Ning Li , Wanli Li , Dayiheng Liu , Dunjie Lu , Changwei Luo , Que Shen , Zheyuan Wang , Zijian Wang , Jie Wu , Gao Wu , Zhihui Xie , Rui Xie , Haiyang Xu , An Yang , Jiakang Yuan , Yanming Zhang , Jiajun Zhang , Xi Zhang , Zhenru Zhang , Zhuo Zhen , Mingkang Zhu , Bowen Zhou

🏛 Institutions: Alibaba Group
📅 Date: September 18, 2026
📑 Publisher: arXiv
💻 Env: Desktop Mobile Web
🔑 Keywords: benchmark dataset RecreationWorld RecreationBench hybrid computer use execution-grounded reward

TLDR

RecreationWorld is a five-platform environment suite (Ubuntu, macOS, Windows, Android, Web) for hybrid computer-use agents that interleave GUI interaction with coding, using a running reference application as an oracle for hidden behavioral tests. Models trained on its generated trajectories improve across five out-of-distribution coding and hybrid benchmarks, and on the held-out 250-task RecreationBench the leading agent reaches 58.1% overall while passing all programmatic tests on only 2.8% of tasks.

Open paper Code Dataset Report issue