Unveiling Disparities in Web Task Handling Between Human and Web Agent
Kihoon Son , Jinhyeon Kwon , DaEun Choi , Tae Soo Kim , Young-Ho Kim , Sangdoo Yun , Juho Kim
- 🏛 Institutions
- KAIST , NAVER AI Lab
- 📅 Date
- May 7, 2024
- 📑 Publisher
- CHI 2024
- 💻 Env
- Web
- 🔑 Keywords
TLDR
This CHI study compares humans and web agents on web tasks using a think-aloud protocol focused on planning, action, and reflection. It finds that humans more actively update task knowledge, resolve ambiguity through additional exploration, and investigate failure causes, exposing missing behaviors in current web-agent designs.
Related papers (24)
- Next-Gen CAPTCHAs: Leveraging the Cognitive Gap for Scalable and Diverse GUI-Agent DefenseFebruary 9, 2026 · ICML 2026
- SusBench: An Online Benchmark for Evaluating Dark Pattern Susceptibility of Computer-Use AgentsOctober 13, 2025 · IUI 2026
- Comparing Computer Use Behavior Across Multiple Levels of AbstractionOctober 19, 2026 · arXiv
- Reflection with Action-Induced Visual Differences for Desktop GUI AgentsAugust 25, 2026 · arXiv
- StepReflect: Structured UI Transition Reflection for Mobile GUI AgentsAugust 6, 2026 · arXiv
- LongHorizonUI: A Unified Framework for Robust long-horizon Task Automation of GUI AgentJanuary 26, 2026 · ICLR 2026 (Poster)
- What Does "Now" Mean to Your Computer-Use Agent? Stale Screenshots, Page Loads, and Which Check to Run Before a ClickOctober 29, 2026 · arXiv
- InterA11y: Interactive Web Accessibility Error Detection with LLM AgentsOctober 29, 2026 · arXiv
- AgentHeal: Evaluating Goal-Preserving Resource Recovery of Web Agents under Access BarriersOctober 29, 2026 · arXiv
- WebAnything: From the Wild Web to Scalable Agent EnvironmentsOctober 27, 2026 · arXiv
- SkillLifeBench: Benchmarking Security Across the Lifecycle of Agent SkillsOctober 26, 2026 · arXiv
- Back to Basics: A Skill-Centric Approach to Generalist Web AgentsOctober 26, 2026 · arXiv
- AgentProofBench: Benchmarking Reusable Verifiers for Web AgentsOctober 25, 2026 · arXiv
- SkillShift-Bench: Benchmarking Skill Learning under Environment Evolution for Web AgentsOctober 24, 2026 · arXiv
- Seeing the Options: Typed Decisions over Visual Candidates with Reusable Option MemoryOctober 24, 2026 · arXiv
- Learning What to Ask for Tomorrow: Active Preference Acquisition for Long-Term Personalized Web AgentsOctober 22, 2026 · arXiv
- Step-Aligned Script Generation with Verification and Recovery for Web Automation TestingOctober 19, 2026 · arXiv
- LoWAgent: A Low-Resource Multilingual Benchmark for Web AgentsOctober 19, 2026 · arXiv
- SPIDES: Information-Flow Control for Browser AgentsOctober 16, 2026 · arXiv
- What It Is, Not What It Says: Securing Agentic Browsing Interactions with Web SemanticsOctober 15, 2026 · arXiv
- Why Generate a Click? Plug-in Decision Heads for Web AgentsOctober 14, 2026 · arXiv
- Teaching Agents in their Own Style: Blackbox Teacher Distillation for Web AgentsOctober 14, 2026 · arXiv
- STP-GUI: Spatially-Aware Token Pruning for Efficient Web-GUI AgentsOctober 14, 2026 · arXiv
- Towards Safe Autonomy for Computer UseOctober 13, 2026 · arXiv