Right Screen, Wrong Transition: World Models as Verifiers for GUI Agents

Jiaming Zhang , Xuan Wang , Fuyao Zhang , Yang Cao , Lingjuan Lyu , Wei Yang Bryan Lim

🏛 Institutions: NTU , Institute of Science Tokyo , Sony AI
📅 Date: October 8, 2026
📑 Publisher: arXiv
💻 Env: Mobile Web Desktop
🔑 Keywords: world model verifier GUI safety transition verification Android WebArena

TLDR

Formulates GUI agent safety as transition verification rather than static screen inspection, noting that identical screens can be benign or malicious depending on the preceding action. Introduces a world-model-based transition verifier that predicts expected screen changes and flags anomalous or redirected transitions across Android and web benchmarks.

Open paper arXiv Report issue