cua-speedrun: Standardized Benchmarking of the Speed of Computer-Use Agents

cua-speedrun provides standardized virtual-machine infrastructure, a common agent interface, and task sets for measuring the speed and cost of computer-use agents across four benchmarks. It shows how reasoning effort, agent harness, and environment latency affect speed, and that most benchmark task sets can be reduced without losing statistical power.

• GUIDE: Interpretable GUI Agent Evaluation via Hierarchical Diagnosis
  April 6, 2026 · arXiv
• PersonaCUABench: Benchmarking Computer-Use Agents Serving Diverse Personas
  October 16, 2026 · arXiv
• A Baseline Assessment for the Agentic Web Technology Stack
  October 9, 2026 · arXiv
• AgentHorizon: Evaluating Agentic Judges for Long-Horizon Computer-Use Tasks
  October 8, 2026 · arXiv
• WebPageBench: Event-Level Verification and Controlled UI-Variant Generation for Web Agents
  September 28, 2026 · arXiv
• MemGUI-Bench: Benchmarking Memory of Mobile GUI Agents in Dynamic Environments
  February 3, 2026 · arXiv
• An Illusion of Progress? Assessing the Current State of Web Agents
  April 2, 2025 · COLM 2025
• GUIFlow: Temporal Redundancy-Aware Incremental Inference for GUI Agents
  October 26, 2026 · arXiv
• IGG: A Benchmark for Interactive GUI Grounding under Visibility Constraints
  October 23, 2026 · arXiv
• PointerBench: A Diagnostic Benchmark for Fine-Grained GUI Grounding
  October 22, 2026 · arXiv
• Who Verifies the Agent's Success Claim? Self-Report Leakage in GUI-Agent Completion Judging
  October 21, 2026 · arXiv
• Beyond Next-Screen Prediction: The Decision Value of GUI World Models
  October 17, 2026 · arXiv
• MMA-SafetyBench: A Benchmark for Multimodal Agent Safety Evaluation
  October 14, 2026 · arXiv
• When to Compile a Computer-Use Agent? Measuring Payback and Making Compilation Decisions for Token Efficiency
  October 2, 2026 · arXiv
• PrecogUI: Proactive GUI Agents via Pre-cognitive Simulation and Experience Retrieval
  September 29, 2026 · arXiv
• LongPuzzleBench: Evaluating GUI Agents on Long-Horizon Visual Puzzles
  September 28, 2026 · arXiv
• The GUI Is Not the State: Diagnosing State Aliasing in GUI World Models
  September 26, 2026 · arXiv
• ScreenHaystack: Finding Blind Zones in GUI Grounding
  September 25, 2026 · EMNLP 2026
• VRL-Bench: Benchmarking agents on computer control tasks under finite trial budgets
  September 11, 2026 · arXiv
• TRACE: Trajectory-robust Admission with Evidence Ordering for Efficient GUI Agents
  September 9, 2026 · arXiv
• FinCUABuild: Can Agents Build Reliable Benchmarks for Dynamic Financial Computer Use?
  September 7, 2026 · arXiv
• Efficient GUI Agents: A Systems Survey of Observation, Memory, Action, and Runtime Optimization
  September 2, 2026 · arXiv
• STaR-KV: Spatio-Temporal Adaptive Re-weighting for KV Cache Compression in GUI Vision-Language Models
  June 1, 2026 · arXiv
• Step-level Optimization for Efficient Computer-use Agents
  April 29, 2026 · arXiv