GUI Agents Papers
Star · 921

DynaWeb: Model-Based Reinforcement Learning of Web Agents

Hang Ding , Peidong Liu , Junqiao Wang , Ziwei Ji , Meng Cao , Rongzhao Zhang , Lynn Ai , Eric Yang , Tianyu Shi , Lei Yu

🏛 Institutions
SJTU , Sichuan University , HKUST , McGill University , Shanghai AI Laboratory , Gradient , University of Toronto , Mila
📅 Date
January 29, 2026
📑 Publisher
arXiv
💻 Env
Web
🔑 Keywords
model-based reinforcement learningworld modelimagined rolloutsWebArenaWebVoyagerDynaWeb
TLDR

DynaWeb trains web agents with model-based reinforcement learning by learning a web world model that supports imagined rollouts, then interleaving those rollouts with real expert trajectories. This synthetic-environment training loop improves open-source web agents on both WebArena and WebVoyager.

Open paper Report issue
Related papers (24)