Agent Alpha: Tree Search Unifying Generation, Exploration and Evaluation for Computer-Use Agents

Agent Alpha applies step-level MCTS with alpha-UCT exploration, comparison-based evaluation, and diversity-aware expansion to computer-use agents. It improves OSWorld performance substantially over trajectory-level sampling under similar compute.

• Tree Search for Language Model Agents
  July 1, 2024 · TMLR 2025
• Agentic Reward Modeling: Verifying GUI Agent via Online Proactive Interaction
  January 31, 2026 · arXiv
• BEAP-Agent: Backtrackable Execution and Adaptive Planning for GUI Agents
  January 29, 2026 · arXiv
• From Off-Policy to On-Policy: Enhancing GUI Agents via Bi-level Expert-to-Policy Assimilation
  January 9, 2026 · arXiv
• R-WoM: Retrieval-augmented World Model For Computer-use Agents
  October 13, 2025 · ICLR 2026 (Poster)
• Just Do It!? Computer-Use Agents Exhibit Blind Goal-Directedness
  October 2, 2025 · ICLR 2026 (Poster)
• Agent S2: A Compositional Generalist-Specialist Framework for Computer Use Agents
  April 1, 2025 · COLM 2025
• IntentScore: Intent-Conditioned Action Evaluation for Computer-Use Agents
  April 6, 2026 · arXiv
• GUIDE: Resolving Domain Bias in GUI Agents through Real-Time Web Video Retrieval and Plug-and-Play Annotation
  March 27, 2026 · arXiv
• EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experience
  January 22, 2026 · arXiv
• CaMeLs Can Use Computers Too: System-level Security for Computer Use Agents
  January 14, 2026 · arXiv
• WebOperator: Action-Aware Tree Search for Autonomous Agents in Web Environment
  December 14, 2025 · arXiv
• Watch and Learn: Learning to Use Computers from Online Videos
  October 6, 2025 · CVPR 2026
• Scaling Agents for Computer Use
  October 2, 2025 · arXiv
• Efficient Multi-turn RL for GUI Agents via Decoupled Training and Adaptive Data Curation
  September 28, 2025 · arXiv
• ComputerRL: Scaling End-to-End Online Reinforcement Learning for Computer Use Agents
  August 19, 2025 · ICLR 2026 (Poster)
• Evolving in Tasks: Empowering the Multi-modality Large Language Model as the Computer Use Agent
  August 6, 2025 · arXiv
• CoAct-1: Computer-using Multi-Agent System with Coding Actions
  August 5, 2025 · ICLR 2026 (Poster)
• LiteCUA: Computer as MCP Server for Computer-Use Agent on AIOS
  May 24, 2025 · arXiv
• LiteWebAgent: The Open-Source Suite for VLM-Based Web-Agent Applications
  March 4, 2025 · NAACL 2025 System Demonstrations
• Attacking Vision-Language Computer Agents via Pop-ups
  November 4, 2024 · ACL 2025
• Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents
  August 13, 2024 · arXiv
• OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
  April 11, 2024 · NeurIPS 2024 Datasets and Benchmarks Track
• Naive Visual Memory is Not Enough: A Failure-Mode Study of GUI Agents
  June 12, 2026 · arXiv