Why Do LLM-based Web Agents Fail? A Hierarchical Planning Perspective
Mohamed Aghzal , Gregory J. Stein , Ziyu Yao
- 🏛 Institutions
- George Mason University
- 📅 Date
- March 15, 2026
- 📑 Publisher
- arXiv
- 💻 Env
- Web
- 🔑 Keywords
TLDR
This paper analyzes web-agent failures through a three-layer hierarchy of high-level planning, low-level execution, and replanning rather than relying only on end-to-end success. It finds that structured PDDL plans improve strategic planning over natural-language plans, but that execution and grounding remain the dominant reliability bottlenecks.
Related papers (24)
- CaptchaAgent: Verifiable Visual Reasoning for CAPTCHA SolvingOctober 9, 2026 · arXiv
- WebFovea: When the Model Is Right but the Click Is Wrong -- Reliable Round Trips for Vision-Based Web Agents on Live WebsitesOctober 2, 2026 · arXiv
- Auditing Web Agent Evaluation on WebArena-Lite: Human Review of Outcomes and TrajectoriesOctober 1, 2026 · NeurIPS 2026 Workshop on Who Verifies the Agents? Toward Reliable Agent Development
- GUITAR: Structured Failure Diagnosis of GUI Agents via State TransitionsSeptember 28, 2026 · arXiv
- Constructing Challenging Browser-Use Tasks by Controlled Environment InterventionsSeptember 20, 2026 · arXiv
- SecureWebArena: A Holistic Security Evaluation Benchmark for LVLM-based Web AgentsOctober 11, 2025 · arXiv
- WebSuite: Systematically Evaluating Why Web Agents FailJune 1, 2024 · arXiv
- VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?April 9, 2024 · COLM 2024
- GPT-4V(ision) is a Generalist Web Agent, if GroundedJanuary 3, 2024 · ICML 2024
- How GUI Agents Fail: GraceBench for Execution Stability DiagnosisOctober 14, 2026 · arXiv
- Absorbed in Inertia: Activation Analysis for Computer-Use AgentsSeptember 29, 2026 · arXiv
- Same Tasks, Different Apps: Why Mobile GUI Agents Fail to Generalize?September 28, 2026 · Findings of EMNLP 2026
- Building Autonomous GUI Navigation via Agentic-Q Estimation and Step-Wise Policy OptimizationFebruary 14, 2026 · arXiv
- Agent S: An Open Agentic Framework that Uses Computers Like a HumanOctober 10, 2024 · ICLR 2025 (Poster)
- Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMsApril 8, 2024 · ECCV 2024 (Poster)
- What Does "Now" Mean to Your Computer-Use Agent? Stale Screenshots, Page Loads, and Which Check to Run Before a ClickOctober 29, 2026 · arXiv
- InterA11y: Interactive Web Accessibility Error Detection with LLM AgentsOctober 29, 2026 · arXiv
- AgentHeal: Evaluating Goal-Preserving Resource Recovery of Web Agents under Access BarriersOctober 29, 2026 · arXiv
- WebAnything: From the Wild Web to Scalable Agent EnvironmentsOctober 27, 2026 · arXiv
- SkillLifeBench: Benchmarking Security Across the Lifecycle of Agent SkillsOctober 26, 2026 · arXiv
- Back to Basics: A Skill-Centric Approach to Generalist Web AgentsOctober 26, 2026 · arXiv
- AgentProofBench: Benchmarking Reusable Verifiers for Web AgentsOctober 25, 2026 · arXiv
- SkillShift-Bench: Benchmarking Skill Learning under Environment Evolution for Web AgentsOctober 24, 2026 · arXiv
- Seeing the Options: Typed Decisions over Visual Candidates with Reusable Option MemoryOctober 24, 2026 · arXiv