CUA-Sandbox: Efficient Environments for Computer-Use Agent Reinforcement Learning
Xin Yan , Zhengbo Jiao , Jiaqi Liu , Zhenglin Wan , SiYuan Ma , Xuliang Yu , Tianyi Jiang , Chubin Zhang , Pengfei Zhou , Wangbo Zhao , Xingrui Yu , Bo An , Yang You , Ivor Tsang
- 🏛 Institutions
- A*STAR , HKUST , Beijing Normal University , NUS , NTU , ZJU , PKU
- 📅 Date
- September 26, 2026
- 📑 Publisher
- arXiv
- 💻 Env
- Web Desktop
- 🔑 Keywords
TLDR
CUA-Sandbox makes computer-use reinforcement learning cheaper by sharing initialized application runtimes across concurrent rollouts while keeping each trajectory's mutable state in a private capsule with transactional resets and branches. It matches or improves task success relative to Docker with up to 6.20x rollout throughput and 9.2x lower per-environment memory.
Related papers (24)
- WebGym: Scaling Training Environments for Visual Web Agents with Realistic TasksJanuary 5, 2026 · arXiv
- WebServ: A Browser-Server Environment for Efficient Training of Reinforcement Learning-based Web Agents at ScaleOctober 17, 2025 · arXiv
- Adaptive-Group Process Rewards for GUI AgentsOctober 13, 2026 · arXiv
- CUAWright: A Minimal Unified Interface for Digital AgentsOctober 2, 2026 · arXiv
- MintAct: A Unified Visual Agent for Digital EnvironmentsSeptember 18, 2026 · arXiv
- SCALECUA: Scaling Computer Use Agents with Verifiable Task Synthesis and Efficient Online RLJuly 13, 2026 · arXiv
- GUI-R1: A Generalist R1-Style Vision-Language Action Model for GUI AgentsApril 14, 2025 · arXiv
- VeriCUA: Learning Proactive Verification for Reliable GUI Agent RewardsOctober 19, 2026 · arXiv
- OS-Helix: Unifying GUI Interaction and Code Execution in Native Computer-Using AgentsOctober 15, 2026 · arXiv
- STP-GUI: Spatially-Aware Token Pruning for Efficient Web-GUI AgentsOctober 14, 2026 · arXiv
- MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer EnvironmentsOctober 14, 2026 · arXiv
- Neuro-Symbolic Computer Use: Learning Reusable Policies for Reliable and Efficient ExecutionSeptember 29, 2026 · arXiv
- HybridCUA: Learning to Orchestrate GUI and CLI for Computer-Use AgentsSeptember 29, 2026 · arXiv
- CaptchaArena: A Large-Scale, Fine-Grained Dataset for Training Computer-Use Agents on Interactive CAPTCHAsSeptember 25, 2026 · arXiv
- SeekJudge: A Practical Reward Framework for Reinforcement Learning in Computer-Use AgentsJuly 25, 2026 · arXiv
- A11y-Compressor: A Framework for Enhancing the Efficiency of GUI Agent Observations through Visual Context Reconstruction and Redundancy ReductionMay 1, 2026 · arXiv
- WebArena-Infinity: Generating Browser Environments with Verifiable Tasks at ScaleMarch 2026 · Blog Post
- Safe and Scalable Web Agent Learning via Recreated WebsitesMarch 11, 2026 · arXiv
- WebFactory: Automated Compression of Foundational Language Intelligence into Grounded Web AgentsMarch 5, 2026 · arXiv
- OpAgent: Operator Agent for Web NavigationFebruary 14, 2026 · arXiv
- Web Agent Agentic Reinforcement Learning Decision Model Under Multi-Cost and Failure RiskJanuary 12, 2026 · arXiv
- STEP: Success-Rate-Aware Trajectory-Efficient Policy OptimizationNovember 17, 2025 · Findings of ACL 2026
- Efficient Multi-turn RL for GUI Agents via Decoupled Training and Adaptive Data CurationSeptember 28, 2025 · arXiv
- ComputerRL: Scaling End-to-End Online Reinforcement Learning for Computer Use AgentsAugust 19, 2025 · ICLR 2026 (Poster)