When Charts Deceive Web Agents: A Paired Benchmark for Misleading Visualization-Grounded Tasks
Yisheng Li , Dongming Han , Hongkun Pan , Bingcheng Mao , Zijian Wang , Yunlong Mao , Wei Tong , Sheng Zhong
- 🏛 Institutions
- NJU , Hithink Research , ZJU
- 📅 Date
- October 9, 2026
- 📑 Publisher
- arXiv
- 💻 Env
- Web
- 🔑 Keywords
TLDR
Introduces a paired benchmark of 280 executable web agent tasks assessing susceptibility to misleading visual charts and deceptive dashboard designs. Demonstrates that frontier multimodal web agents frequently misinterpret truncated axes and inverted scales, making erroneous navigation and purchasing decisions.
Related papers (24)
- AgentHeal: Evaluating Goal-Preserving Resource Recovery of Web Agents under Access BarriersOctober 29, 2026 · arXiv
- SkillLifeBench: Benchmarking Security Across the Lifecycle of Agent SkillsOctober 26, 2026 · arXiv
- AgentProofBench: Benchmarking Reusable Verifiers for Web AgentsOctober 25, 2026 · arXiv
- SkillShift-Bench: Benchmarking Skill Learning under Environment Evolution for Web AgentsOctober 24, 2026 · arXiv
- LoWAgent: A Low-Resource Multilingual Benchmark for Web AgentsOctober 19, 2026 · arXiv
- Adversarial Images Hijack Web Agents from Visual Grounding to Browser ExecutionOctober 7, 2026 · arXiv
- DashAct: A Progressive Diagnostic Benchmark for GUI Agents in Interactive Dashboard AnalysisSeptember 26, 2026 · arXiv
- CocoaBench: Evaluating Unified Digital Agents in the WildApril 13, 2026 · arXiv
- InterA11y: Interactive Web Accessibility Error Detection with LLM AgentsOctober 29, 2026 · arXiv
- WebAnything: From the Wild Web to Scalable Agent EnvironmentsOctober 27, 2026 · arXiv
- Back to Basics: A Skill-Centric Approach to Generalist Web AgentsOctober 26, 2026 · arXiv
- Learning What to Ask for Tomorrow: Active Preference Acquisition for Long-Term Personalized Web AgentsOctober 22, 2026 · arXiv
- Step-Aligned Script Generation with Verification and Recovery for Web Automation TestingOctober 19, 2026 · arXiv
- Why Generate a Click? Plug-in Decision Heads for Web AgentsOctober 14, 2026 · arXiv
- Teaching Agents in their Own Style: Blackbox Teacher Distillation for Web AgentsOctober 14, 2026 · arXiv
- STP-GUI: Spatially-Aware Token Pruning for Efficient Web-GUI AgentsOctober 14, 2026 · arXiv
- MHVF: Training-Free GUI Grounding via Verification-Guided Multi-Hypothesis SearchOctober 13, 2026 · arXiv
- Seg2Click: Learning Pixel-Level Action Masks for GUI Visual GroundingOctober 12, 2026 · arXiv
- BrowseSafe++: Benchmarking Prompt Injection Detection Across Web Contexts, Languages, and Browser ViewsOctober 12, 2026 · arXiv
- Web$hell: A Unified Interface for Agentic Web AccessOctober 9, 2026 · arXiv
- A Baseline Assessment for the Agentic Web Technology StackOctober 9, 2026 · arXiv
- AgentHorizon: Evaluating Agentic Judges for Long-Horizon Computer-Use TasksOctober 8, 2026 · arXiv
- AdvSim2Real : Training Web Agents Against Adaptive Prompt Injection in a Web World ModelOctober 6, 2026 · arXiv
- PlaySuite: A Large-Scale Benchmark for Interactive Visual IntelligenceOctober 5, 2026 · arXiv