A Baseline Assessment for the Agentic Web Technology Stack

Introduces MASTIF, an evaluation framework assessing combinations of 3 LLMs, 3 communication protocols, and 4 agent implementation frameworks across 300 Mind2Web benchmark tasks. Provides systematic baseline metrics on task completion, execution time, and communication verbosity across alternative agentic web stacks.

• AgentHorizon: Evaluating Agentic Judges for Long-Horizon Computer-Use Tasks
  October 8, 2026 · arXiv
• WebPageBench: Event-Level Verification and Controlled UI-Variant Generation for Web Agents
  September 28, 2026 · arXiv
• An Illusion of Progress? Assessing the Current State of Web Agents
  April 2, 2025 · COLM 2025
• From Grounding to Planning: Benchmarking Bottlenecks in Web Agents
  September 3, 2024 · ECAI 2025
• Mind2Web: Towards a Generalist Agent for the Web
  June 9, 2023 · NeurIPS 2023 Datasets and Benchmarks Track
• PersonaCUABench: Benchmarking Computer-Use Agents Serving Diverse Personas
  October 16, 2026 · arXiv
• cua-speedrun: Standardized Benchmarking of the Speed of Computer-Use Agents
  September 30, 2026 · arXiv
• GUIDE: Interpretable GUI Agent Evaluation via Hierarchical Diagnosis
  April 6, 2026 · arXiv
• MemGUI-Bench: Benchmarking Memory of Mobile GUI Agents in Dynamic Environments
  February 3, 2026 · arXiv
• AgentHeal: Evaluating Goal-Preserving Resource Recovery of Web Agents under Access Barriers
  October 29, 2026 · arXiv
• SkillLifeBench: Benchmarking Security Across the Lifecycle of Agent Skills
  October 26, 2026 · arXiv
• AgentProofBench: Benchmarking Reusable Verifiers for Web Agents
  October 25, 2026 · arXiv
• SkillShift-Bench: Benchmarking Skill Learning under Environment Evolution for Web Agents
  October 24, 2026 · arXiv
• LoWAgent: A Low-Resource Multilingual Benchmark for Web Agents
  October 19, 2026 · arXiv
• Teaching Agents in their Own Style: Blackbox Teacher Distillation for Web Agents
  October 14, 2026 · arXiv
• Learning How to Remember: Memory Modality Selection for GUI Agents
  October 13, 2026 · arXiv
• Interaction-as-a-Judge
  October 13, 2026 · arXiv
• HyWe: Unifying Search and Operation for Real-World Hybrid Web Tasks
  October 12, 2026 · arXiv
• BrowseSafe++: Benchmarking Prompt Injection Detection Across Web Contexts, Languages, and Browser Views
  October 12, 2026 · arXiv
• When Charts Deceive Web Agents: A Paired Benchmark for Misleading Visualization-Grounded Tasks
  October 9, 2026 · arXiv
• Web$hell: A Unified Interface for Agentic Web Access
  October 9, 2026 · arXiv
• PlaySuite: A Large-Scale Benchmark for Interactive Visual Intelligence
  October 5, 2026 · arXiv
• CLIFT: Conformal Self-Verification for Web Agent Training and Test-Time Scaling
  October 5, 2026 · arXiv
• TeleTune: Evolving Agent Skills From Offline Telemetry
  October 4, 2026 · arXiv