CUA-Universe: A Scalable and Dynamic Environment for Hybrid GUI+CLI Agents
Haoting Shi , Wenhao Wang , Weicheng Fang , Yaozhong Liang , Tian Jin , Pengxiang Zhao , Guangyi Liu , Siheng Chen , Yanfeng Wang
- 🏛 Institutions
- SJTU , ZJU
- 📅 Date
- September 4, 2026
- 📑 Publisher
- arXiv
- 💻 Env
- Desktop
- 🔑 Keywords
TLDR
CUA-Universe is an environment-to-data pipeline that turns real desktop software into hybrid GUI+CLI environments over shared application state, targeting agents that coordinate visual inspection with command-line throughput.
Related papers (24)
- VeriCUA: Learning Proactive Verification for Reliable GUI Agent RewardsOctober 19, 2026 · arXiv
- Adaptation of Computer Use Agents to New Software with User ManualsOctober 16, 2026 · arXiv
- OpenGCUA: Toward a Fully Open Stack for Generalist Computer UseOctober 15, 2026 · arXiv
- OS-Helix: Unifying GUI Interaction and Code Execution in Native Computer-Using AgentsOctober 15, 2026 · arXiv
- LEASH: Uncertainty-Aware Weak-to-Strong Escalation and Oversight for Computer-Use AgentsOctober 15, 2026 · arXiv
- Task-State Governance: A Virtual Machine for Verifiable and Recoverable GUI Agent ExecutionOctober 14, 2026 · arXiv
- A Decade in a Day: Synthesizing Agent-Native Interfaces from Human-Oriented Software EvolutionOctober 11, 2026 · arXiv
- CUA-SWE: When Computer-Use Agents Meet Visual Software EngineeringSeptember 26, 2026 · arXiv
- Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI AgentsSeptember 15, 2026 · arXiv
- EchoPath: Execution-Level Replayable Memory for GUI AgentsSeptember 15, 2026 · arXiv
- RSIAgent: Autonomous Exploration for Recursive Self-improvement in New EnvironmentsSeptember 14, 2026 · arXiv
- OmegaUse-SOP: SOP Engineering for Professional Computer Use from Human DemonstrationsSeptember 2, 2026 · arXiv
- ASIL: Replacing Screenshot-and-Click with Structured State and Semantic ActionsAugust 27, 2026 · arXiv
- VLAA-GUI: Knowing When to Stop, Recover, and Search, A Modular Framework for GUI AutomationApril 23, 2026 · arXiv
- EE-MCP: Self-Evolving MCP-GUI Agents via Automated Environment Generation and Experience LearningApril 10, 2026 · arXiv
- EntWorld: A Holistic Environment and Benchmark for Verifiable Enterprise GUI AgentsJanuary 25, 2026 · arXiv
- ShowUI-Aloha: Human-Taught GUI AgentJanuary 12, 2026 · arXiv
- Surfer 2: The Next Generation of Cross-Platform Computer Use AgentsOctober 22, 2025 · arXiv
- BIMgent: Towards Autonomous Building Modeling via Computer-use AgentsJune 8, 2025 · ICML 2025 Workshop on Computer-use Agents
- ScienceBoard: Evaluating Multimodal Autonomous Agents in Realistic Scientific WorkflowsMay 26, 2025 · ICLR 2026 (Poster)
- LiteCUA: Computer as MCP Server for Computer-Use Agent on AIOSMay 24, 2025 · arXiv
- UFO2: The Desktop AgentOSApril 20, 2025 · arXiv
- WorldGUI: An Interactive Benchmark for Desktop GUI Automation from Any Starting PointFebruary 12, 2025 · arXiv
- PC Agent: While You Sleep, AI Works -- A Cognitive Journey into Digital WorldDecember 23, 2024 · arXiv