GUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent Environments

Lin Fu , Zheyuan Yang , Tianhui Zhang , Jinbiao Wei , Guo Gan , Boxu Liu , Yilun Zhao , Yu Rong

🏛 Institutions: Yale University , ZJU , China University of Geosciences , DAMO Academy, Alibaba Group , Tongji University , UC San Diego
📅 Date: August 30, 2026
📑 Publisher: arXiv
💻 Env: Mobile
🔑 Keywords: benchmark world model contextual consistency GUI-CC

TLDR

GUI-CC evaluates GUI world models as multi-step environments rather than one-step next-screen predictors, via an offline reference-action track over real mobile trajectories and an online agent-loop track that stresses contextual consistency over long horizons.

Open paper Report issue

Related papers (24)

MobileWorldBench: Towards Semantic World Modeling For Mobile Agents

December 16, 2025 · arXiv
PrecogUI: Proactive GUI Agents via Pre-cognitive Simulation and Experience Retrieval

September 29, 2026 · arXiv
The GUI Is Not the State: Diagnosing State Aliasing in GUI World Models

September 26, 2026 · arXiv
iPrefBench: A User-Centric Benchmark for Personalized Mobile Use Agents

October 26, 2026 · arXiv
AndroidFlux: Evaluating Failure Recovery and Recovery Action Reward Modeling in Mobile-Use Multimodal Agents

October 25, 2026 · arXiv
Beyond Next-Screen Prediction: The Decision Value of GUI World Models

October 17, 2026 · arXiv
MobileJailBench: Red Queen Jailbreak Benchmarking for Mobile Agents

October 16, 2026 · arXiv
MobileInject: Evaluating Reasoning-to-Action Security of MLLM-Based Mobile Agents under Cross-Modal Consistency Injection

October 16, 2026 · arXiv
Not All Graphs Are Maps: A Task-Agnostic Exploration Framework for Mobile GUI Navigation

October 15, 2026 · arXiv
MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer Environments

October 14, 2026 · arXiv
How GUI Agents Fail: GraceBench for Execution Stability Diagnosis

October 14, 2026 · arXiv
OpenMobile-2: Building Versatile Mobile Agents with Scalable Environments and App-Native Tools

October 9, 2026 · arXiv
Right Screen, Wrong Transition: World Models as Verifiers for GUI Agents

October 8, 2026 · arXiv
Can Agents Work for Everyone? Cross-User Reliability for Mobile GUI Agents in Personalized User Interfaces

October 6, 2026 · arXiv
Imagine to Act: High-Fidelity Data Synthesis via Image Editing World Model for Scalable GUI Agent Training

October 5, 2026 · arXiv
Same Tasks, Different Apps: Why Mobile GUI Agents Fail to Generalize?

September 28, 2026 · Findings of EMNLP 2026
MATE: Policy-Aware Security Auditing for Mobile Agents via Synthesis-Driven Trajectory Learning

September 19, 2026 · USENIX Security 2026
RecreationWorld: Scalable and Verifiable Environments for Hybrid Computer-Use Agents

September 18, 2026 · arXiv
PriMobiBench: Characterizing Visual Privacy Leakage in VLM-Driven Mobile GUI Agents

September 12, 2026 · arXiv
JarvisGUI: Towards Cross-Device GUI Agents with Dynamic Task Composition

September 9, 2026 · arXiv
APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agents

September 7, 2026 · arXiv
ElderBench: Benchmarking Autonomous Mobile Agents for Older Adults

September 4, 2026 · arXiv
WM-R1: Training GUI Agents to Reason and leverage World Models with Reinforcement Learning

August 27, 2026 · arXiv
Are Android GUI Agents Robust Against Runtime Anomalies? AnTrap: Evaluating Agents in Dynamic Adversarial Environments

August 25, 2026 · arXiv