The Dawn of GUI Agent: A Preliminary Case Study with Claude 3.5 Computer Use

This case study probes Claude 3.5 Computer Use on curated desktop tasks spanning multiple software domains. It also provides a simple framework for deploying API-based GUI automation models and documents where planning, action execution, and critic behavior still fail in real-world settings.

• ANCHOR: Branch-Point Data Generation for GUI Agents
  February 6, 2026 · arXiv
• CUA-Skill: Develop Skills for Computer Using Agent
  January 28, 2026 · arXiv
• ASSISTGUI: Task-Oriented Desktop Graphical User Interface Automation
  December 20, 2023 · CVPR 2024 (Poster)
• OS-Wizard: Scaling Computer-Using Agents to Specialized Software via Knowledge-Guided Exploration
  October 24, 2026 · arXiv
• Evolving Agent Interfaces
  October 20, 2026 · arXiv
• CUA-Recovery: Benchmarking Error Recovery in Long-Horizon Computer-Use Agents
  October 20, 2026 · arXiv
• VeriCUA: Learning Proactive Verification for Reliable GUI Agent Rewards
  October 19, 2026 · arXiv
• Comparing Computer Use Behavior Across Multiple Levels of Abstraction
  October 19, 2026 · arXiv
• CUA-Lite: An Open Platform for Computer Use Agents
  October 19, 2026 · arXiv
• Agent World Model in the Wild: Computer-Use Agent Environment Synthesis
  October 19, 2026 · arXiv
• PersonaCUABench: Benchmarking Computer-Use Agents Serving Diverse Personas
  October 16, 2026 · arXiv
• Adaptation of Computer Use Agents to New Software with User Manuals
  October 16, 2026 · arXiv
• OpenGCUA: Toward a Fully Open Stack for Generalist Computer Use
  October 15, 2026 · arXiv
• OS-Helix: Unifying GUI Interaction and Code Execution in Native Computer-Using Agents
  October 15, 2026 · arXiv
• LEASH: Uncertainty-Aware Weak-to-Strong Escalation and Oversight for Computer-Use Agents
  October 15, 2026 · arXiv
• Task-State Governance: A Virtual Machine for Verifiable and Recoverable GUI Agent Execution
  October 14, 2026 · arXiv
• MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer Environments
  October 14, 2026 · arXiv
• Towards Safe Autonomy for Computer Use
  October 13, 2026 · arXiv
• Pack Light, CarryOn: Building Object-Oriented Context for Long-Horizon Agents
  October 13, 2026 · arXiv
• Learning How to Remember: Memory Modality Selection for GUI Agents
  October 13, 2026 · arXiv
• Interaction-as-a-Judge
  October 13, 2026 · arXiv
• Adaptive-Group Process Rewards for GUI Agents
  October 13, 2026 · arXiv
• PrivacyGuard: Source-Linked Sanitization and Locally Resolvable PII References for Cloud GUI Agents
  October 12, 2026 · arXiv
• Learn from Move: the Next Step for GUI Agents
  October 12, 2026 · arXiv