See, Plan, Snap: Evaluating Multimodal GUI Agents in Scratch

ScratchWorld evaluates multimodal GUI agents on Scratch program construction tasks that require fine-grained drag-and-drop manipulation. The benchmark exposes a large gap between high-level planning success and low-level GUI execution.

• UI-Vision: A Desktop-centric GUI Benchmark for Visual Perception and Interaction
  March 19, 2025 · ICML 2025 (Poster)
• IGG: A Benchmark for Interactive GUI Grounding under Visibility Constraints
  October 23, 2026 · arXiv
• PointerBench: A Diagnostic Benchmark for Fine-Grained GUI Grounding
  October 22, 2026 · arXiv
• MMA-SafetyBench: A Benchmark for Multimodal Agent Safety Evaluation
  October 14, 2026 · arXiv
• cua-speedrun: Standardized Benchmarking of the Speed of Computer-Use Agents
  September 30, 2026 · arXiv
• PrecogUI: Proactive GUI Agents via Pre-cognitive Simulation and Experience Retrieval
  September 29, 2026 · arXiv
• LongPuzzleBench: Evaluating GUI Agents on Long-Horizon Visual Puzzles
  September 28, 2026 · arXiv
• The GUI Is Not the State: Diagnosing State Aliasing in GUI World Models
  September 26, 2026 · arXiv
• ScreenHaystack: Finding Blind Zones in GUI Grounding
  September 25, 2026 · EMNLP 2026
• VRL-Bench: Benchmarking agents on computer control tasks under finite trial budgets
  September 11, 2026 · arXiv
• FinCUABuild: Can Agents Build Reliable Benchmarks for Dynamic Financial Computer Use?
  September 7, 2026 · arXiv
• AutoGUI-v2: A Comprehensive Multi-Modal GUI Functionality Understanding Benchmark
  April 27, 2026 · arXiv
• GUI-Perturbed: Domain Randomization Reveals Systematic Brittleness in GUI Grounding Models
  April 15, 2026 · arXiv
• CocoaBench: Evaluating Unified Digital Agents in the Wild
  April 13, 2026 · arXiv
• What's Missing in Screen-to-Action? Towards a UI-in-the-Loop Paradigm for Multimodal GUI Reasoning
  April 8, 2026 · Findings of ACL 2026
• GUIDE: Interpretable GUI Agent Evaluation via Hierarchical Diagnosis
  April 6, 2026 · arXiv
• GUIDE: A Benchmark for Understanding and Assisting Users in Open-Ended GUI Tasks
  March 26, 2026 · CVPR 2026
• LPS-Bench: Benchmarking Safety Awareness of Computer-Use Agents in Long-Horizon Planning under Benign and Adversarial Scenarios
  February 3, 2026 · arXiv
• LongHorizonUI: A Unified Framework for Robust long-horizon Task Automation of GUI Agent
  January 26, 2026 · ICLR 2026 (Poster)
• GUIGuard: Toward a General Framework for Privacy-Preserving GUI Agents
  January 26, 2026 · arXiv
• DrawingBench: Evaluating Spatial Reasoning and UI Interaction Capabilities of Large Language Models through Mouse-Based Drawing Tasks
  December 1, 2025 · AAAI 2026 TrustAgent Workshop
• MPR-GUI: Benchmarking and Enhancing Multilingual Perception and Reasoning in GUI Agents
  November 30, 2025 · arXiv
• Beyond Clicking: A Step Towards Generalist GUI Grounding via Text Dragging
  November 7, 2025 · arXiv
• SCUBA: Salesforce Computer Use Benchmark
  September 30, 2025 · ICLR 2026 (Poster)