Code2World: A GUI World Model via Renderable Code Generation

Yuhao Zheng , Li'an Zhong , Yi Wang , Rui Dai , Kaikui Liu , Xiangxiang Chu , Linyuan Lv , Philip Torr , Kevin Qinghong Lin

🏛 Institutions: USTC , AMAP , Alibaba Group , Sun Yat-sen University , Oxford
📅 Date: February 10, 2026
📑 Publisher: arXiv
💻 Env: Mobile
🔑 Keywords: world model renderable code generation AndroidCode render-aware reinforcement learning next-state prediction Code2World

TLDR

Code2World models GUI dynamics by generating renderable code for the next interface state rather than directly predicting pixels. Trained on AndroidCode with render-aware RL, it improves next-state prediction and downstream Android navigation.

Open paper arXiv Code Report issue

Related papers (24)

GUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent Environments

August 30, 2026 · arXiv
WM-R1: Training GUI Agents to Reason and leverage World Models with Reinforcement Learning

August 27, 2026 · arXiv
AppDeltaWorld: Transition-Grounded Delta Code World Model for Mobile GUI Agents

August 6, 2026 · arXiv
Scaling GUI Agents with Visual State Transitions

July 27, 2026 · arXiv
SeerGuard: A Safety Framework for Mobile GUI Agents via World Model Prediction

July 17, 2026 · arXiv
How Mobile World Model Guides GUI Agents?

May 11, 2026 · arXiv
UI-Oceanus: Scaling GUI Agents with Synthetic Environmental Dynamics

February 11, 2026 · arXiv
MobileDreamer: Generative Sketch World Model for GUI Agent

January 7, 2026 · arXiv
MobileWorldBench: Towards Semantic World Modeling For Mobile Agents

December 16, 2025 · arXiv
Unlocking Smarter Device Control: Foresighted Planning with a World Model-Driven Code Execution Approach

May 22, 2025 · Findings of EMNLP 2025
Discriminative World Models for Web Agents

September 2, 2026 · arXiv
World-Model-Augmented Web Agents with Action Correction

February 17, 2026 · arXiv
WebWorld: A Large-Scale World Model for Web Agent Training

February 16, 2026 · arXiv
SafePred: A Predictive Guardrail for Computer-Using Agents via World Models

February 2, 2026 · arXiv
DynaWeb: Model-Based Reinforcement Learning of Web Agents

January 29, 2026 · arXiv
R-WoM: Retrieval-augmented World Model For Computer-use Agents

October 13, 2025 · ICLR 2026 (Poster)
Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agents

November 10, 2024 · TMLR
BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agents

September 11, 2026 · arXiv
JarvisGUI: Towards Cross-Device GUI Agents with Dynamic Task Composition

September 9, 2026 · arXiv
APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agents

September 7, 2026 · arXiv
Improving Proficiency and Efficiency of Android GUI Agents via Self-Generating Tool Actions

September 6, 2026 · arXiv
ElderBench: Benchmarking Autonomous Mobile Agents for Older Adults

September 4, 2026 · arXiv
WiP: Characterizing and Defending Against Mobile-Agent-Driven MFA Automation

September 2, 2026 · arXiv
ActReal: System-Level Mobile Agents Challenge Mobile Automation Detection

August 30, 2026 · arXiv