OSWorld-Pro: Process-based Evaluation for Computer Use Agents

OSWorld-Pro is a set of over 300 tasks with over 2,800 subgoals, grounded in more than 67,000 human annotations, that evaluates computer-use agents on the process rather than only the end state, using human-aligned LLM judges. The top performer, Claude Opus 5, reaches 75.7% against 83.4% on OSWorld, and the analysis surfaces process failures such as subgoal-irrelevant actions and click mistakes.

• CUA-Lite: An Open Platform for Computer Use Agents
  October 19, 2026 · arXiv
• MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer Environments
  October 14, 2026 · arXiv
• AgentHorizon: Evaluating Agentic Judges for Long-Horizon Computer-Use Tasks
  October 8, 2026 · arXiv
• Control OSWorld: An AI Control Environment for GUI Computer Use Agents
  October 2, 2026 · arXiv
• Talk2Agent: Benchmarking Voice Interfaces for Text Agents
  September 30, 2026 · arXiv
• OSWorld-Science: A Benchmark of Computer Use Agents for Learning and Using Scientific Software
  September 30, 2026 · arXiv
• OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
  April 11, 2024 · NeurIPS 2024 Datasets and Benchmarks Track
• Evolving Agent Interfaces
  October 20, 2026 · arXiv
• CUA-Recovery: Benchmarking Error Recovery in Long-Horizon Computer-Use Agents
  October 20, 2026 · arXiv
• Agent World Model in the Wild: Computer-Use Agent Environment Synthesis
  October 19, 2026 · arXiv
• PersonaCUABench: Benchmarking Computer-Use Agents Serving Diverse Personas
  October 16, 2026 · arXiv
• OpenGCUA: Toward a Fully Open Stack for Generalist Computer Use
  October 15, 2026 · arXiv
• OS-Helix: Unifying GUI Interaction and Code Execution in Native Computer-Using Agents
  October 15, 2026 · arXiv
• LEASH: Uncertainty-Aware Weak-to-Strong Escalation and Oversight for Computer-Use Agents
  October 15, 2026 · arXiv
• Pack Light, CarryOn: Building Object-Oriented Context for Long-Horizon Agents
  October 13, 2026 · arXiv
• Learning How to Remember: Memory Modality Selection for GUI Agents
  October 13, 2026 · arXiv
• A Decade in a Day: Synthesizing Agent-Native Interfaces from Human-Oriented Software Evolution
  October 11, 2026 · arXiv
• Work2Skill: Capturing Human GUI Experience for Reusable Agent Skill Induction
  October 9, 2026 · arXiv
• Latent World Action Model for GUI Agents
  October 9, 2026 · arXiv
• PlaySuite: A Large-Scale Benchmark for Interactive Visual Intelligence
  October 5, 2026 · arXiv
• MedImageOSWorld: Benchmarking GUI Agents for Medical Image Consoles
  October 3, 2026 · arXiv
• CUAWright: A Minimal Unified Interface for Digital Agents
  October 2, 2026 · arXiv
• GUI-HARVEST: Self-Improving GUI Agents through Evidence-Driven Harness Evolution
  October 1, 2026 · arXiv
• AutoGUIWorld: Image Generators as Visual World Models for GUI Agent
  October 1, 2026 · arXiv