SCALECUA: Scaling Computer Use Agents with Verifiable Task Synthesis and Efficient Online RL

SCALECUA couples Docker-based verifiable task synthesis with frontier sampling and a visual-context segmentation training system for online CUA reinforcement learning. The released framework covers task generation, RL training, and OSWorld/ScienceBoard evaluation.

• GUI-R1: A Generalist R1-Style Vision-Language Action Model for GUI Agents
  April 14, 2025 · arXiv
• SeekJudge: A Practical Reward Framework for Reinforcement Learning in Computer-Use Agents
  July 25, 2026 · arXiv
• WebArena-Infinity: Generating Browser Environments with Verifiable Tasks at Scale
  March 2026 · Blog Post
• WebFactory: Automated Compression of Foundational Language Intelligence into Grounded Web Agents
  March 5, 2026 · arXiv
• OpAgent: Operator Agent for Web Navigation
  February 14, 2026 · arXiv
• WebGym: Scaling Training Environments for Visual Web Agents with Realistic Tasks
  January 5, 2026 · arXiv
• STEP: Success-Rate-Aware Trajectory-Efficient Policy Optimization
  November 17, 2025 · Findings of ACL 2026
• WebServ: A Browser-Server Environment for Efficient Training of Reinforcement Learning-based Web Agents at Scale
  October 17, 2025 · arXiv
• Efficient Multi-turn RL for GUI Agents via Decoupled Training and Adaptive Data Curation
  September 28, 2025 · arXiv
• ComputerRL: Scaling End-to-End Online Reinforcement Learning for Computer Use Agents
  August 19, 2025 · ICLR 2026 (Poster)
• Thinking vs. Doing: Agents that Reason by Scaling Test-Time Interaction
  June 9, 2025 · SEA @ NeurIPS 2025 (Oral)
• DPO Learning with LLMs-Judge Signal for Computer Use Agents
  June 3, 2025 · arXiv
• ZeroGUI: Automating Online GUI Learning at Zero Human Cost
  May 29, 2025 · arXiv
• WebDancer: Towards Autonomous Information Seeking Agency
  May 28, 2025 · NeurIPS 2025 (Poster)
• WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learning
  May 22, 2025 · EMNLP 2025 (Poster)
• ARPO:End-to-End Policy Optimization for GUI Agents with Experience Replay
  May 22, 2025 · arXiv
• Advancing Autonomous VLM Agents via Variational Subgoal-Conditioned Reinforcement Learning
  February 11, 2025 · arXiv
• Proposer-Agent-Evaluator (PAE): Autonomous Skill Discovery For Foundation Model Internet Agents
  December 17, 2024 · ICML 2025 (Poster)
• WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learning
  November 4, 2024 · ICLR 2025 (Poster)
• Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents
  August 13, 2024 · arXiv
• Navigating WebAI: Training Agents to Complete Web Tasks with Large Language Models and Reinforcement Learning
  May 1, 2024 · SAC 2024
• Grounded Language Agent for Product Search via Intelligent Web Interactions
  April 16, 2024 · CustomNLP4U @ NAACL 2024
• AutoWebGLM: A Large Language Model-based Web Navigating Agent
  April 4, 2024 · KDD 2024
• A Data-Driven Approach for Learning to Control Computers
  February 16, 2022 · ICML 2022