Mapping the Design Space of User Experience for Computer Use Agents

Ruijia Cheng, Jenny T. Liang, Eldon Schoop, Jeffrey Nichols

🏛 Institutions: Apple, CMU
📅 Date: February 7, 2026
📑 Publisher: IUI 2026
💻 Env: Desktop
🔑 Keywords: UX design human-computer interaction user study taxonomy wizard-of-oz

TLDR

This paper maps the UX design space for computer-use agents through expert interviews and Wizard-of-Oz studies. It contributes a taxonomy covering prompts, explainability, control, and mental models for agent-driven software interaction.

Open paper arXiv Edit on GitHub Report issue