WebPageBench: Event-Level Verification and Controlled UI-Variant Generation for Web Agents

Anton Emelyanov , Maria Tikhonova , Zaven Martirosian , Sergei Averkiev , Alena Fenogenova

🏛 Institutions: DAIMLD , HSE University , NUST MISIS
📅 Date: September 28, 2026
📑 Publisher: arXiv
💻 Env: Web
🔑 Keywords: WebPageBench benchmark event-level verification UI variation evaluation

TLDR

WebPageBench verifies each web-agent task from the interface's own event log across six instrumented mock sites, with no judge model, and supports controlled UI variation that re-renders one control while keeping the prompt and success conditions fixed. On its 152-task leaderboard, the gap between what agents declare finished and what the log confirms reaches 41 points.

Open paper Report issue