GUIGuard: Toward a General Framework for Privacy-Preserving GUI Agents

Yanxi Wang , Zhiling Zhang , Wenbo Zhou , Weiming Zhang , Jie Zhang , Qiannan Zhu , Yu Shi , Shuxin Zheng , Jiyan He

🏛 Institutions: Beijing Normal University , Zhongguancun Academy , USTC , A*STAR , Zhongguancun Institution of Artificial Intelligence
📅 Date: January 26, 2026
📑 Publisher: arXiv
💻 Env: General GUI
🔑 Keywords: benchmark dataset privacy recognition privacy protection privacy grounding GUIGuard GUIGuard-Bench

TLDR

GUIGuard formulates privacy-preserving GUI automation as privacy recognition, privacy protection, and protected task execution. It also introduces GUIGuard-Bench, a cross-platform benchmark with 630 trajectories and 13,830 screenshots annotated for region-level privacy grounding, risk level, privacy category, and task necessity, and shows that current models still recognize private content very poorly.

Open paper arXiv Report issue