WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents

Shunyu Yao, Howard Chen, John Yang, Karthik Narasimhan

🏛 Institutions: Princeton
📅 Date: July 31, 2022
📑 Publisher: NeurIPS 2022
💻 Env: Web
🔑 Keywords: environment dataset benchmark e-commerce web interaction WebShop

TLDR

Introduces WebShop, an e-commerce web environment with over one million products and 12,087 shopping instructions for grounded language agents. It became an early standard benchmark for web agents by combining realistic web interaction, compositional search, and sim-to-real evaluation.

Open paper Edit on GitHub Report issue

Related papers

WebForge: Breaking the Realism-Reproducibility-Scalability Trilemma in Browser Agent Benchmark

April 13, 2026 · arXiv
WebArena-Infinity: Generating Browser Environments with Verifiable Tasks at Scale

March 2026 · Blog Post
WebChain: A Large-Scale Human-Annotated Dataset of Real-World Web Interaction Traces

March 5, 2026 · arXiv
Web-CogReasoner: Towards Knowledge-Induced Cognitive Reasoning for Web Agents

August 3, 2025 · ICLR 2026 (Poster)
Web-Shepherd: Advancing PRMs for Reinforcing Web Agents

May 21, 2025 · NeurIPS 2025 (Spotlight)
RealWebAssist: A Benchmark for Long-Horizon Web Assistance with Real-World Users

April 14, 2025 · AAAI 2026