ERPBench: A State-Grounded Evaluation Paradigm for Computer-Use Agents in Enterprise Software

ERPBench evaluates screenshot-only computer-use agents on a live, reproducible ERP system and scores each task against ground-truth values in the underlying database rather than on-screen appearance. Across six closed and open-source agents it shows that strong general GUI performance does not transfer to enterprise reliability: some agents save a form in up to 85% of runs but write the correct value in as few as 3%.

• AgentHeal: Evaluating Goal-Preserving Resource Recovery of Web Agents under Access Barriers
  October 29, 2026 · arXiv
• SkillLifeBench: Benchmarking Security Across the Lifecycle of Agent Skills
  October 26, 2026 · arXiv
• AgentProofBench: Benchmarking Reusable Verifiers for Web Agents
  October 25, 2026 · arXiv
• SkillShift-Bench: Benchmarking Skill Learning under Environment Evolution for Web Agents
  October 24, 2026 · arXiv
• LoWAgent: A Low-Resource Multilingual Benchmark for Web Agents
  October 19, 2026 · arXiv
• BrowseSafe++: Benchmarking Prompt Injection Detection Across Web Contexts, Languages, and Browser Views
  October 12, 2026 · arXiv
• When Charts Deceive Web Agents: A Paired Benchmark for Misleading Visualization-Grounded Tasks
  October 9, 2026 · arXiv
• A Baseline Assessment for the Agentic Web Technology Stack
  October 9, 2026 · arXiv
• AgentHorizon: Evaluating Agentic Judges for Long-Horizon Computer-Use Tasks
  October 8, 2026 · arXiv
• PlaySuite: A Large-Scale Benchmark for Interactive Visual Intelligence
  October 5, 2026 · arXiv
• Securing Computer-Use Agents Against Branch Steering Attacks
  October 2, 2026 · NeurIPS 2026 Workshop on Agents in the Wild
• AdaptArena: Evaluating Test-Time Personalization of Web Agents
  September 29, 2026 · arXiv
• WebPageBench: Event-Level Verification and Controlled UI-Variant Generation for Web Agents
  September 28, 2026 · arXiv
• DashAct: A Progressive Diagnostic Benchmark for GUI Agents in Interactive Dashboard Analysis
  September 26, 2026 · arXiv
• AgentTell: Behavioural Side-Channel Leakage in Browser-Use Agents
  September 26, 2026 · arXiv
• The Hard Part Comes After Search: Benchmarking Web Agents on Synthesizing, Organizing, and Displaying Knowledge
  September 24, 2026 · Findings of EMNLP 2026
• Invisible in Space, Visible in Time: Motion Vision CAPTCHA against GUI Agents
  September 23, 2026 · ACM MM 2026
• Guides That Cause Actions: An Offline Study of Guide-Action Mutual Reinforcement in Multimodal Web Agents
  September 23, 2026 · arXiv
• CAVEAT: Towards Robust Computer-Use Agents in Incentive-Misaligned Environments
  September 23, 2026 · arXiv
• Constructing Challenging Browser-Use Tasks by Controlled Environment Interventions
  September 20, 2026 · arXiv
• RecreationWorld: Scalable and Verifiable Environments for Hybrid Computer-Use Agents
  September 18, 2026 · arXiv
• VRL-Bench: Benchmarking agents on computer control tasks under finite trial budgets
  September 11, 2026 · arXiv
• ComponentBench: Diagnosing Component-Level Failures in Computer-Use Agents
  August 18, 2026 · COLM 2026
• StepJack: Benchmarking Computer-Use Agent Safety Against Multi-Step Indirect Prompt Injection
  August 6, 2026 · arXiv