UI-Oceanus: Scaling GUI Agents with Synthetic Environmental Dynamics
Mengzhou Wu , Yuzhe Guo , Yuan Cao , Haochuan Lu , Songhe Zhu , Pingzhe Qu , Xin Chen , Kang Qin , Zhongpu Wang , Xiaode Zhang , Xinyi Wang , Wei Dai , Gang Cao , Yuetang Deng , Zhi Gong , Dezhi Ran , Linyi Li , Wei Yang , Tao Xie
- 🏛 Institutions
- PKU , Tencent
- 📅 Date
- February 11, 2026
- 📑 Publisher
- arXiv
- 💻 Env
- Mobile
- 🔑 Keywords
TLDR
UI-Oceanus shifts learning from mimicking trajectories to mastering interaction physics via forward dynamics prediction. Using synthetic environmental dynamics as supervision, it improves GUI agents by 7% on offline benchmarks and 16.8% in online navigation, with performance scaling log-linearly with data volume.
Related papers (24)
- WebWorld: A Large-Scale World Model for Web Agent TrainingFebruary 16, 2026 · arXiv
- BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI AgentsSeptember 11, 2026 · arXiv
- GUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent EnvironmentsAugust 30, 2026 · arXiv
- WM-R1: Training GUI Agents to Reason and leverage World Models with Reinforcement LearningAugust 27, 2026 · arXiv
- AppDeltaWorld: Transition-Grounded Delta Code World Model for Mobile GUI AgentsAugust 6, 2026 · arXiv
- Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI AgentsJuly 30, 2026 · arXiv
- Scaling GUI Agents with Visual State TransitionsJuly 27, 2026 · arXiv
- SEE: Structure-aware Exploring and Exploiting for Long-horizon GUI Agent Trajectory SynthesisJuly 20, 2026 · arXiv
- SeerGuard: A Safety Framework for Mobile GUI Agents via World Model PredictionJuly 17, 2026 · arXiv
- Xiaomi-GUI-0 Technical ReportJune 30, 2026 · arXiv
- How Mobile World Model Guides GUI Agents?May 11, 2026 · arXiv
- ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI AgentsApril 13, 2026 · arXiv
- SecAgent: Efficient Mobile GUI Agent with Semantic ContextMarch 9, 2026 · arXiv
- CoME: Empowering Channel-of-Mobile-Experts with Informative Hybrid-Capabilities ReasoningFebruary 27, 2026 · ICML 2026 (Poster)
- Mobile-Agent-v3.5: Multi-platform Fundamental GUI AgentsFebruary 15, 2026 · arXiv
- Code2World: A GUI World Model via Renderable Code GenerationFebruary 10, 2026 · arXiv
- Learning with Challenges: Adaptive Difficulty-Aware Data Generation for Mobile GUI Agent TrainingJanuary 30, 2026 · arXiv
- OmegaUse: Building a General-Purpose GUI Agent for Autonomous Task ExecutionJanuary 28, 2026 · arXiv
- MobileDreamer: Generative Sketch World Model for GUI AgentJanuary 7, 2026 · arXiv
- MAI-UI Technical Report: Real-World Centric Foundation GUI AgentsDecember 26, 2025 · arXiv
- Step-GUI Technical ReportDecember 17, 2025 · arXiv
- MobileWorldBench: Towards Semantic World Modeling For Mobile AgentsDecember 16, 2025 · arXiv
- AFRAgent : An Adaptive Feature Renormalization Based High Resolution Aware GUI agentNovember 30, 2025 · WACV 2026
- ScaleCUA: Scaling Open-Source Computer Use Agents with Cross-Platform DataSeptember 18, 2025 · ICLR 2026 (Oral)