WebSRC: A Dataset for Web-Based Structural Reading Comprehension

WebSRC introduces structural reading comprehension over real webpages, with 400K question-answer pairs drawn from 6.4K pages and accompanied by HTML, screenshots, and metadata. It is a benchmark for answering questions that require reasoning over page structure rather than plain text alone.

• WebForge: Breaking the Realism-Reproducibility-Scalability Trilemma in Browser Agent Benchmark
  April 13, 2026 · arXiv
• WebArena-Infinity: Generating Browser Environments with Verifiable Tasks at Scale
  March 2026 · Blog Post
• WebChain: A Large-Scale Human-Annotated Dataset of Real-World Web Interaction Traces
  March 5, 2026 · arXiv
• Web-CogReasoner: Towards Knowledge-Induced Cognitive Reasoning for Web Agents
  August 3, 2025 · ICLR 2026 (Poster)
• Web-Shepherd: Advancing PRMs for Reinforcing Web Agents
  May 21, 2025 · NeurIPS 2025 (Spotlight)
• RealWebAssist: A Benchmark for Long-Horizon Web Assistance with Real-World Users
  April 14, 2025 · AAAI 2026
• AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectories
  April 11, 2025 · COLM 2025
• WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Tasks
  July 7, 2024 · NeurIPS 2024 Datasets and Benchmarks Track (Poster)
• GUI Action Narrator: Where and When Did That Action Take Place?
  June 19, 2024 · arXiv
• WebCanvas: Benchmarking Web Agents in Online Environments
  June 18, 2024 · arXiv
• GUI-World: A Video Benchmark and Dataset for Multimodal GUI-oriented Understanding
  June 16, 2024 · ICLR 2025 (Poster)
• OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Web
  February 29, 2024 · ECCV 2024 (Poster)
• On the Multi-turn Instruction Following for Conversational Web Agents
  February 23, 2024 · ACL 2024
• WebLINX: Real-World Website Navigation with Multi-Turn Dialogue
  February 8, 2024 · ICML 2024
• SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents
  January 17, 2024 · ACL 2024
• WebVLN: Vision-and-Language Navigation on Websites
  December 25, 2023 · AAAI 2024
• Mind2Web: Towards a Generalist Agent for the Web
  June 9, 2023 · NeurIPS 2023 Datasets and Benchmarks Track
• WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents
  July 31, 2022 · NeurIPS 2022
• Grounding Open-Domain Instructions to Automate Web Support Tasks
  March 30, 2021 · NAACL 2021
• Gym-Anything: Turn any Software into an Agent Environment
  April 7, 2026 · arXiv
• PSPA-Bench: A Personalized Benchmark for Smartphone GUI Agent
  March 31, 2026 · arXiv
• SecAgent: Efficient Mobile GUI Agent with Semantic Context
  March 9, 2026 · arXiv
• Turing Test on Screen: A Benchmark for Mobile GUI Agent Humanization
  February 24, 2026 · arXiv
• AmbiBench: Benchmarking Mobile GUI Agents Beyond One-Shot Instructions in the Wild
  February 12, 2026 · arXiv