Workflow-GYM: Towards Long-Horizon Evaluation of Computer-use Agentic tasks in Real-World Professional Fields
Liya Zhu , Jingzhe Ding , Jian Zhang , Jianbo Xue , Shihao Liang , Ge Zhang , Yi Zhu , Duju Zeng , Xiang Gao , Qingshui Gu , Mailun Gao , Huimin Che , Yan Zhao , Peiheng Zhou , Haojun Wang , Chaobo Xian , Lili Le , Chi Wu , Yiwei Liu , Shengda Long , Jiale Yang , Fangzhi Xu , Sijin Wu , Haodong Duan , Chao He , Zhaojian Li , Minchao Wang , Huan Zhou , Jiani Hou , Chuqian Yu , Weiran Shi , Hongwan Gao , Jiamin Chen , Guanhong Chen , Tingqin Luo , Kaiyuan Zhang , Zhixin Yao , Qing Hua , Yuhao Jiang , Jin Chen , Pu Chen , Zhenyu Hu , Xingyu Li , Zhengxuan Jiang , Meng Cao , Tianfeng Long , Haozhe Wang , Mingzhang Wang , Yichen Zhang , Yiming Dai , Chenchen Zhang , Jiaying Wang , Xinying Liu , Xingzu Liu , Lingling Zhang , Xinjie Chen , Yujia Qin , Wangchunshu Zhou , Zhiyong Wu , Yang Liu , Jiaheng Liu , Lei Zhang , Shen Yan , Wenhao Huang , Zaiyuan Wang , Xiaolong Chang
- 🏛 Institutions
- Unknown
- 📅 Date
- June 9, 2026
- 📑 Publisher
- arXiv
- 💻 Env
- Desktop
- 🔑 Keywords
Workflow-GYM is a benchmark for long-horizon computer-use tasks in professional software environments. It evaluates whether agents can complete domain-specific workflows through GUIs and reports that current state-of-the-art models still struggle with end-to-end professional tasks.
- CUA-Recovery: Benchmarking Error Recovery in Long-Horizon Computer-Use AgentsOctober 20, 2026 · arXiv
- HealthAdminBench: Evaluating Computer-Use Agents on Healthcare Administration TasksApril 10, 2026 · arXiv
- Gym-Anything: Turn any Software into an Agent EnvironmentApril 7, 2026 · arXiv
- OS-Marathon: Benchmarking Computer-Use Agents on Long-Horizon Repetitive TasksJanuary 28, 2026 · arXiv
- PrecogUI: Proactive GUI Agents via Pre-cognitive Simulation and Experience RetrievalSeptember 29, 2026 · arXiv
- LongPuzzleBench: Evaluating GUI Agents on Long-Horizon Visual PuzzlesSeptember 28, 2026 · arXiv
- The Hard Part Comes After Search: Benchmarking Web Agents on Synthesizing, Organizing, and Displaying KnowledgeSeptember 24, 2026 · Findings of EMNLP 2026
- ScaleWoB: Guiding GUI Agents with Coding Agents via Large-Scale Environmental SynthesisMay 24, 2026 · arXiv
- CocoaBench: Evaluating Unified Digital Agents in the WildApril 13, 2026 · arXiv
- ClawBench: Can AI Agents Complete Everyday Online Tasks?April 9, 2026 · arXiv
- AndroTMem: From Interaction Trajectories to Anchored Memory in Long-Horizon GUI AgentsMarch 19, 2026 · arXiv
- MobileBench-OL: A Comprehensive Chinese Benchmark for Evaluating Mobile GUI Agents in Real-World EnvironmentJanuary 28, 2026 · Findings of ACL 2026
- LongHorizonUI: A Unified Framework for Robust long-horizon Task Automation of GUI AgentJanuary 26, 2026 · ICLR 2026 (Poster)
- MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented EnvironmentsDecember 22, 2025 · arXiv
- AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?October 21, 2024 · EMNLP 2024 (Poster)
- CUA-Lite: An Open Platform for Computer Use AgentsOctober 19, 2026 · arXiv
- PersonaCUABench: Benchmarking Computer-Use Agents Serving Diverse PersonasOctober 16, 2026 · arXiv
- MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer EnvironmentsOctober 14, 2026 · arXiv
- A Decade in a Day: Synthesizing Agent-Native Interfaces from Human-Oriented Software EvolutionOctober 11, 2026 · arXiv
- AgentHorizon: Evaluating Agentic Judges for Long-Horizon Computer-Use TasksOctober 8, 2026 · arXiv
- PlaySuite: A Large-Scale Benchmark for Interactive Visual IntelligenceOctober 5, 2026 · arXiv
- MedImageOSWorld: Benchmarking GUI Agents for Medical Image ConsolesOctober 3, 2026 · arXiv
- Control OSWorld: An AI Control Environment for GUI Computer Use AgentsOctober 2, 2026 · arXiv
- DeskForge: Dense Supervision from Desktop Environments for Computer-Use AgentsOctober 1, 2026 · arXiv