SoftwareGym: Scaling Computer-Use Agent Training with Diverse Synthesized Software Environments
Tian Jin , Wenhao Wang , Jing Kang , Haoting Shi , Rui Ye , Yijun Lu , Siheng Chen
- 🏛 Institutions
- SJTU , ZJU
- 📅 Date
- October 8, 2026
- 📑 Publisher
- arXiv
- 💻 Env
- Desktop
- 🔑 Keywords
TLDR
Introduces SoftwareGym, a platform that scales computer-use agent training by synthesizing diverse desktop software applications and programmatic verifiers. Pre-training agents with reinforcement learning across 1,200+ synthesized software environments substantially boosts out-of-domain transfer performance on OSWorld.
Related papers (24)
- CUA-Recovery: Benchmarking Error Recovery in Long-Horizon Computer-Use AgentsOctober 20, 2026 · arXiv
- Agent World Model in the Wild: Computer-Use Agent Environment SynthesisOctober 19, 2026 · arXiv
- Interaction-as-a-JudgeOctober 13, 2026 · arXiv
- Secure-CUA: Controlling Untrusted Influence in Computer-Use AgentsOctober 7, 2026 · arXiv
- PlaySuite: A Large-Scale Benchmark for Interactive Visual IntelligenceOctober 5, 2026 · arXiv
- Control OSWorld: An AI Control Environment for GUI Computer Use AgentsOctober 2, 2026 · arXiv
- DeskForge: Dense Supervision from Desktop Environments for Computer-Use AgentsOctober 1, 2026 · arXiv
- What Does "Now" Mean to Your Computer-Use Agent? Stale Screenshots, Page Loads, and Which Check to Run Before a ClickOctober 29, 2026 · arXiv
- Lost in Recovery: Demystifying Recovery Behavior of Computer-Use Agents via Goal-Oriented Action ReplayOctober 20, 2026 · arXiv
- ScaleWoB: Guiding GUI Agents with Coding Agents via Large-Scale Environmental SynthesisMay 24, 2026 · arXiv
- Step-level Optimization for Efficient Computer-use AgentsApril 29, 2026 · arXiv
- WebArena-Infinity: Generating Browser Environments with Verifiable Tasks at ScaleMarch 2026 · Blog Post
- WebFactory: Automated Compression of Foundational Language Intelligence into Grounded Web AgentsMarch 5, 2026 · arXiv
- GUI-GENESIS: Automated Synthesis of Efficient Environments with Verifiable Rewards for GUI Agent Post-TrainingFebruary 15, 2026 · arXiv
- AutoWebWorld: Synthesizing Infinite Verifiable Web Environments via Finite State MachinesFebruary 15, 2026 · arXiv
- InfiniteWeb: Scalable Web Environment Synthesis for GUI Agent TrainingJanuary 7, 2026 · arXiv
- OS-Wizard: Scaling Computer-Using Agents to Specialized Software via Knowledge-Guided ExplorationOctober 24, 2026 · arXiv
- Evolving Agent InterfacesOctober 20, 2026 · arXiv
- VeriCUA: Learning Proactive Verification for Reliable GUI Agent RewardsOctober 19, 2026 · arXiv
- Comparing Computer Use Behavior Across Multiple Levels of AbstractionOctober 19, 2026 · arXiv
- CUA-Lite: An Open Platform for Computer Use AgentsOctober 19, 2026 · arXiv
- PersonaCUABench: Benchmarking Computer-Use Agents Serving Diverse PersonasOctober 16, 2026 · arXiv
- Adaptation of Computer Use Agents to New Software with User ManualsOctober 16, 2026 · arXiv
- OpenGCUA: Toward a Fully Open Stack for Generalist Computer UseOctober 15, 2026 · arXiv