Don't Act Blindly: Robust GUI Automation via Action-Effect Verification and Self-Correction

Yuzhe Zhang, Xianwei Xue, Xingyong Wu, Mengke Chen, Chen Liu, Xinran He, Run Shao, Feiran Liu, Huanmin Xu, Qiutong Pan, Haiwei Wang

🏛 Institutions: Unknown
📅 Date: April 7, 2026
📑 Publisher: ACL 2026
💻 Env: Mobile
🔑 Keywords: benchmark reinforcement learning GRPO action verification self-correction VeriGUI AndroidControl

TLDR

VeriGUI treats action-effect verification as a first-class RL objective to handle non-deterministic GUI environments with network delays, rendering lags, and system failures. A Thinking-Verification-Action-Expectation framework identifies failures; two-phase training with Robust SFT and GRPO using asymmetric verification rewards reduces failure loops. A new Robustness Benchmark built on AndroidControl evaluates failure recognition and correction.

Open paper arXiv Edit on GitHub Report issue