Code2World: A GUI World Model via Renderable Code Generation

Yuhao Zheng , Li'an Zhong , Yi Wang , Rui Dai , Kaikui Liu , Xiangxiang Chu , Linyuan Lv , Philip Torr , Kevin Qinghong Lin

🏛 Institutions: USTC , AMAP , Alibaba Group , Sun Yat-sen University , Oxford
📅 Date: February 10, 2026
📑 Publisher: arXiv
💻 Env: Mobile
🔑 Keywords: world model renderable code generation AndroidCode render-aware reinforcement learning next-state prediction Code2World

TLDR

Code2World models GUI dynamics by generating renderable code for the next interface state rather than directly predicting pixels. Trained on AndroidCode with render-aware RL, it improves next-state prediction and downstream Android navigation.

Open paper arXiv Report issue

Related papers (24)

UI-Oceanus: Scaling GUI Agents with Synthetic Environmental Dynamics

February 11, 2026 · arXiv
MobileDreamer: Generative Sketch World Model for GUI Agent

January 7, 2026 · arXiv
MobileWorldBench: Towards Semantic World Modeling For Mobile Agents

December 16, 2025 · arXiv
Unlocking Smarter Device Control: Foresighted Planning with a World Model-Driven Code Execution Approach

May 22, 2025 · Findings of EMNLP 2025
World-Model-Augmented Web Agents with Action Correction

February 17, 2026 · arXiv
WebWorld: A Large-Scale World Model for Web Agent Training

February 16, 2026 · arXiv
SafePred: A Predictive Guardrail for Computer-Using Agents via World Models

February 2, 2026 · arXiv
DynaWeb: Model-Based Reinforcement Learning of Web Agents

January 29, 2026 · arXiv
R-WoM: Retrieval-augmented World Model For Computer-use Agents

October 13, 2025 · ICLR 2026 (Poster)
Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agents

November 10, 2024 · TMLR
Benchmarking Living-Screen-Native GUI Agents on Short-Video Platforms

June 3, 2026 · arXiv
Context-Aware Workflow Decomposition for Automated Mobile UI Annotation Using Multimodal Large Language Models

June 1, 2026 · arXiv
UI-KOBE: Knowledge-Oriented Behavior Exploration for Lightweight Graph-Guided GUI Agents

May 28, 2026 · arXiv
AndroidDaily: A Verifiable Benchmark for Mobile GUI Agents on Real-World Closed-Source Applications

May 26, 2026 · arXiv
MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research

May 25, 2026 · arXiv
SimuWoB: Simulating Real-World Mobile Apps for Fast and Faithful GUI Agent Benchmarking

May 24, 2026 · arXiv
SE-GA: Memory-Augmented Self-Evolution for GUI Agents

May 16, 2026 · arXiv
ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agents

April 13, 2026 · arXiv
CORA: Conformal Risk-Controlled Agents for Safeguarded Mobile GUI Automation

April 10, 2026 · arXiv
KnowU-Bench: Towards Interactive, Proactive, and Personalized Mobile Agent Evaluation

April 9, 2026 · arXiv
Android Coach: Improve Online Agentic Training Efficiency with Single State Multiple Actions

April 8, 2026 · arXiv
Don't Act Blindly: Robust GUI Automation via Action-Effect Verification and Self-Correction

April 7, 2026 · ACL 2026
Proactive Agent Research Environment: Simulating Active Users to Evaluate Proactive Assistants

April 1, 2026 · arXiv
PSPA-Bench: A Personalized Benchmark for Smartphone GUI Agent

March 31, 2026 · arXiv