A Survey on the Safety and Security Threats of Computer-Using Agents: JARVIS or Ultron?

Ada Chen, Yongjiang Wu, Junyuan Zhang, Jingyu Xiao, Shu Yang, Jen-tse Huang, Kun Wang, Wenxuan Wang, Shuai Wang

🏛 Institutions: CMU, CUHK, KAUST, JHU, NTU, HKUST
📅 Date: May 16, 2025
📑 Publisher: arXiv
💻 Env: General GUI
🔑 Keywords: survey safety security threat taxonomy defense taxonomy

TLDR

This survey systematizes safety and security risks in computer-using agents, from reasoning failures and multimodal vulnerabilities to risks introduced by multi-component agent stacks. It organizes the field around threat categories, defensive strategies, and the benchmarks and datasets currently used to study secure CUA deployment.

Open paper arXiv Edit on GitHub Report issue