WebTestPilot: Agentic End-to-End Web Testing against Natural Language Specification by Inferring Oracles with Symbolized GUI Elements

Xiwen Teoh, Yun Lin, Duc-Minh Nguyen, Ruofei Ren, Wenjie Zhang, Jin Song Dong

🏛 Institutions: NUS, SJTU
📅 Date: February 12, 2026
📑 Publisher: arXiv
💻 Env: Web
🔑 Keywords: web testing bug detection GUI grounding test oracle symbolized GUI elements WebTestPilot

TLDR

WebTestPilot is an agentic end-to-end web-testing system that symbolizes GUI elements and infers test oracles from natural-language specifications. It achieves high precision and recall on bug-injected web apps and outperforms existing baselines in automated web testing.

Open paper arXiv Edit on GitHub Report issue