GUI Agents Papers
Star · 751

CowPilot: A Framework for Autonomous and Human-Agent Collaborative Web Navigation

Faria Huq, Zora Zhiruo Wang, Frank F. Xu, Tianyue Ou, Shuyan Zhou, Jeffrey P. Bigham, Graham Neubig

🏛 Institutions
CMU
📅 Date
April 30, 2025
📑 Publisher
NAACL 2025 (System Demonstrations)
💻 Env
Web
🔑 Keywords
TLDR

CowPilot is a mixed-initiative web-navigation framework where an agent proposes next steps while the user can pause, reject, override, or hand control back at any time. Across five websites, the collaborative mode reaches the highest success rate while requiring humans to perform only a small fraction of the total steps, and the system is also positioned as a data-collection and evaluation tool.

Open paper Edit on GitHub Report issue
Related papers