Scaling GUI Agents with Visual State Transitions

State Transition Pretraining jointly learns inverse dynamics and forward GUI dynamics from visual state transitions before instruction-conditioned trajectory fine-tuning. The paper evaluates the resulting models on desktop and mobile agent benchmarks and releases its official implementation.

• GUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent Environments
  August 30, 2026 · arXiv
• WM-R1: Training GUI Agents to Reason and leverage World Models with Reinforcement Learning
  August 27, 2026 · arXiv
• AppDeltaWorld: Transition-Grounded Delta Code World Model for Mobile GUI Agents
  August 6, 2026 · arXiv
• SeerGuard: A Safety Framework for Mobile GUI Agents via World Model Prediction
  July 17, 2026 · arXiv
• How Mobile World Model Guides GUI Agents?
  May 11, 2026 · arXiv
• UI-Oceanus: Scaling GUI Agents with Synthetic Environmental Dynamics
  February 11, 2026 · arXiv
• Code2World: A GUI World Model via Renderable Code Generation
  February 10, 2026 · arXiv
• MobileDreamer: Generative Sketch World Model for GUI Agent
  January 7, 2026 · arXiv
• MobileWorldBench: Towards Semantic World Modeling For Mobile Agents
  December 16, 2025 · arXiv
• Unlocking Smarter Device Control: Foresighted Planning with a World Model-Driven Code Execution Approach
  May 22, 2025 · Findings of EMNLP 2025
• UIBert: Learning Generic Multimodal Representations for UI Understanding
  July 29, 2021 · IJCAI 2021
• JarvisGUI: Towards Cross-Device GUI Agents with Dynamic Task Composition
  September 9, 2026 · arXiv
• Discriminative World Models for Web Agents
  September 2, 2026 · arXiv
• ADeptS-Bench: Measuring the Trustworthiness of Computer Use Agents Across Devices
  August 25, 2026 · arXiv
• MAGA: Multi-Platform Self-Fusion of GUI Agents via Structured Action Distillation
  July 31, 2026 · arXiv
• Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI Agents
  July 30, 2026 · arXiv
• OSReward: Instituting Standardized Evaluation for Cross-Platform Computer-Use Reward Models
  July 30, 2026 · arXiv
• Video2GUI: Synthesizing Large-Scale Interaction Trajectories for Generalized GUI Agent Pretraining
  May 14, 2026 · arXiv
• Video-Based Reward Modeling for Computer-Use Agents
  March 10, 2026 · arXiv
• PIRA-Bench: A Transition from Reactive GUI Agents to GUI-based Proactive Intent Recommendation Agents
  March 9, 2026 · arXiv
• World-Model-Augmented Web Agents with Action Correction
  February 17, 2026 · arXiv
• WebWorld: A Large-Scale World Model for Web Agent Training
  February 16, 2026 · arXiv
• Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agents
  February 15, 2026 · arXiv
• SafePred: A Predictive Guardrail for Computer-Using Agents via World Models
  February 2, 2026 · arXiv