CowPilot: A Framework for Autonomous and Human-Agent Collaborative Web Navigation

Faria Huq , Zora Zhiruo Wang , Frank F. Xu , Tianyue Ou , Shuyan Zhou , Jeffrey P. Bigham , Graham Neubig

🏛 Institutions: CMU
📅 Date: April 30, 2025
📑 Publisher: NAACL 2025 (System Demonstrations)
💻 Env: Web
🔑 Keywords: framework human-agent collaboration mixed-initiative web navigation data collection CowPilot

TLDR

CowPilot is a mixed-initiative web-navigation framework where an agent proposes next steps while the user can pause, reject, override, or hand control back at any time. Across five websites, the collaborative mode reaches the highest success rate while requiring humans to perform only a small fraction of the total steps, and the system is also positioned as a data-collection and evaluation tool.

Open paper Report issue