Towards Trustworthy GUI Agents: A Survey

Yucheng Shi , Wenhao Yu , Jingyuan Huang , Wenlin Yao , Wenhu Chen , Ninghao Liu

🏛 Institutions: University of Georgia , Tencent AI Seattle Lab , MSR , University of Waterloo , PolyU
📅 Date: March 30, 2025
📑 Publisher: arXiv
💻 Env: General GUI
🔑 Keywords: survey trustworthiness Perception Trust Reasoning Trust Interaction Trust

TLDR

This survey studies trustworthy GUI agents through a workflow-aligned taxonomy that separates trust into Perception Trust, Reasoning Trust, and Interaction Trust. It reviews benign failures, adversarial attacks, defenses, and evaluation practices, arguing that task completion alone is insufficient for trust assessment.

Open paper arXiv Report issue