VRL-Bench: Benchmarking agents on computer control tasks under finite trial budgets

Yu Bai , Yukai Miao , Dawei Wang , Li Chen , Yanyu Ren , Yuqian Shi , Dan Li , Ying Xiong , Chengqiu Tan , Run Zhou , Li Li

🏛 Institutions: Zhongguancun Laboratory , Tsinghua University , Network Management Center, China Mobile
📅 Date: September 11, 2026
📑 Publisher: arXiv
💻 Env: Web General GUI
🔑 Keywords: benchmark verbal reinforcement learning trial budget exploration-exploitation VRL-Bench

TLDR

VRL-Bench is a harness for fairly comparing verbal-reinforcement-learning and trial-and-error-memory methods on computer control under a fixed trial budget, evaluated on MiniWoB and WebShop. It finds reflection can reduce success under tight budgets and proposes VEX², an exploration-exploitation scheduler.

Open paper Report issue