PersonaCUABench: Benchmarking Computer-Use Agents Serving Diverse Personas
Haoming Li , Defu Cao , Xu Hu , Yingtao Luo , Yiyang Wang , Xianghe Xu , Jiashu He , Wanting Jiang , Yifan Zhang , Yunhan Zhao , Siyang Wu , Chen Yang , Haixin Wang , Zheyuan Deng , Taoran Li , Jingwen Zhang , Zhejian Peng , Shushu Liang , Yue Zhao , Bingzhe Li , Feng Chen , Yifan Wang , Jintao Huang , Yijun Wang , Yuexing Hao , Xiaomin Li
- 🏛 Institutions
- UT Dallas , USC , CMU , Georgia Tech , UCLA , UPenn , Amherst College , Vanderbilt University , UC Irvine , University of Chicago , Harvard , Brown University , Texas A&M , UIUC , Purdue University , OSU , MIT
- 📅 Date
- October 16, 2026
- 📑 Publisher
- arXiv
- 💻 Env
- Desktop
- 🔑 Keywords
TLDR
Introduces PersonaCUABench, an evaluation suite assessing computer-use agents across 44 user personas to examine how colloquial expressions, ambiguous constraints, and personalized requirements degrade agent success in desktop environments.
Related papers (24)
- AgentHorizon: Evaluating Agentic Judges for Long-Horizon Computer-Use TasksOctober 8, 2026 · arXiv
- CUA-Lite: An Open Platform for Computer Use AgentsOctober 19, 2026 · arXiv
- A Baseline Assessment for the Agentic Web Technology StackOctober 9, 2026 · arXiv
- cua-speedrun: Standardized Benchmarking of the Speed of Computer-Use AgentsSeptember 30, 2026 · arXiv
- WebPageBench: Event-Level Verification and Controlled UI-Variant Generation for Web AgentsSeptember 28, 2026 · arXiv
- GUIDE: Interpretable GUI Agent Evaluation via Hierarchical DiagnosisApril 6, 2026 · arXiv
- MemGUI-Bench: Benchmarking Memory of Mobile GUI Agents in Dynamic EnvironmentsFebruary 3, 2026 · arXiv
- An Illusion of Progress? Assessing the Current State of Web AgentsApril 2, 2025 · COLM 2025
- CUA-Recovery: Benchmarking Error Recovery in Long-Horizon Computer-Use AgentsOctober 20, 2026 · arXiv
- VeriCUA: Learning Proactive Verification for Reliable GUI Agent RewardsOctober 19, 2026 · arXiv
- Comparing Computer Use Behavior Across Multiple Levels of AbstractionOctober 19, 2026 · arXiv
- Agent World Model in the Wild: Computer-Use Agent Environment SynthesisOctober 19, 2026 · arXiv
- Adaptation of Computer Use Agents to New Software with User ManualsOctober 16, 2026 · arXiv
- OpenGCUA: Toward a Fully Open Stack for Generalist Computer UseOctober 15, 2026 · arXiv
- OS-Helix: Unifying GUI Interaction and Code Execution in Native Computer-Using AgentsOctober 15, 2026 · arXiv
- LEASH: Uncertainty-Aware Weak-to-Strong Escalation and Oversight for Computer-Use AgentsOctober 15, 2026 · arXiv
- MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer EnvironmentsOctober 14, 2026 · arXiv
- Interaction-as-a-JudgeOctober 13, 2026 · arXiv
- A Decade in a Day: Synthesizing Agent-Native Interfaces from Human-Oriented Software EvolutionOctober 11, 2026 · arXiv
- PlaySuite: A Large-Scale Benchmark for Interactive Visual IntelligenceOctober 5, 2026 · arXiv
- MedImageOSWorld: Benchmarking GUI Agents for Medical Image ConsolesOctober 3, 2026 · arXiv
- Control OSWorld: An AI Control Environment for GUI Computer Use AgentsOctober 2, 2026 · arXiv
- Talk2Agent: Benchmarking Voice Interfaces for Text AgentsSeptember 30, 2026 · arXiv
- OSWorld-Science: A Benchmark of Computer Use Agents for Learning and Using Scientific SoftwareSeptember 30, 2026 · arXiv