Beyond Next-Screen Prediction: The Decision Value of GUI World Models

Analyzes the decision value of GUI world models and finds lookahead benefits stem primarily from candidate evaluators rather than future screen prediction, introducing Direct Action Ranking (DAR) which outperforms world model rollouts on AndroidWorld.

• Imagine to Act: High-Fidelity Data Synthesis via Image Editing World Model for Scalable GUI Agent Training
  October 5, 2026 · arXiv
• The GUI Is Not the State: Diagnosing State Aliasing in GUI World Models
  September 26, 2026 · arXiv
• ScopeMem: Latent Memory That Learns Where to Revise Frozen GUI Agents
  October 19, 2026 · arXiv
• Right Click, Wrong Box: Grading GUI Grounding by What a Click Does
  October 27, 2026 · arXiv
• Learning to Look Beyond Screens: Transferable Visual Observation from GUI Grounding
  October 27, 2026 · arXiv
• AdaGround: Token-Normalized Adaptive Zooming with Verifier-in-the-Loop Refinement for GUI Grounding
  October 27, 2026 · arXiv
• AndroidFlux: Evaluating Failure Recovery and Recovery Action Reward Modeling in Mobile-Use Multimodal Agents
  October 25, 2026 · arXiv
• PreView: Enhancing GUI Grounding with Preprocessed Views and Cues
  October 24, 2026 · arXiv
• IGG: A Benchmark for Interactive GUI Grounding under Visibility Constraints
  October 23, 2026 · arXiv
• Trace2World: Reconstructing App Worlds from Real Interaction Traces for Scalable GUI Agent Training
  October 22, 2026 · arXiv
• PointerBench: A Diagnostic Benchmark for Fine-Grained GUI Grounding
  October 22, 2026 · arXiv
• Who Verifies the Agent's Success Claim? Self-Report Leakage in GUI-Agent Completion Judging
  October 21, 2026 · arXiv
• Agent World Model in the Wild: Computer-Use Agent Environment Synthesis
  October 19, 2026 · arXiv
• GroundGUI: GUI Grounding by High-Quality Data and Distillation-to-Reinforcement Learning
  October 13, 2026 · arXiv
• Seg2Click: Learning Pixel-Level Action Masks for GUI Visual Grounding
  October 12, 2026 · arXiv
• ConClick: Element-Wise Contrastive Learning Improves GUI Grounding
  October 9, 2026 · arXiv
• Right Screen, Wrong Transition: World Models as Verifiers for GUI Agents
  October 8, 2026 · arXiv
• DeltaReplay: Task-Relative Memory Reuse for Mobile GUI Agents
  October 8, 2026 · arXiv
• Decoupling What from Where: How Should a Small GUI Grounding Model Receive the Action Type?
  October 5, 2026 · arXiv
• Recurrent Latent Visual Search for GUI Grounding
  October 4, 2026 · arXiv
• cua-speedrun: Standardized Benchmarking of the Speed of Computer-Use Agents
  September 30, 2026 · arXiv
• SCA: Spatial Credit Assignment for Reinforcement Learning of GUI Agents
  September 29, 2026 · arXiv
• PrecogUI: Proactive GUI Agents via Pre-cognitive Simulation and Experience Retrieval
  September 29, 2026 · arXiv
• PhoneCLI: From App Interfaces to Callable Commands for Mobile Agents
  September 28, 2026 · arXiv