How Smart Is Your GUI Agent? A Framework for the Future of Software Interaction

Sidong Feng, Chunyang Chen

🏛 Institutions: CUHK-Shenzhen, TUM
📅 Date: February 12, 2026
📑 Publisher: arXiv
💻 Env: General GUI
🔑 Keywords: autonomy levels taxonomy trustworthy AI software interaction GUI Agent Autonomy Levels conceptual framework

TLDR

This paper is a conceptual framing proposal rather than a new agent system. It introduces GUI Agent Autonomy Levels, a six-level taxonomy for describing capability, responsibility, and risk, with the goal of giving the field a clearer language for benchmarking and trustworthy deployment.

Open paper arXiv Edit on GitHub Report issue