GUI Agents Papers
Star · 821

sudo rm -rf agentic_security

Sejin Lee , Jian Kim , Haon Park , Ashkan Yousefpour , Sangyoon Yu , Min Song

🏛 Institutions
Aim Intelligence , Yonsei University , SNU
📅 Date
March 26, 2025
📑 Publisher
ACL 2025 Industry Track
💻 Env
Desktop Web
🔑 Keywords
TLDR

SUDO is a screen-based jailbreak attack for computer-use agents that rewrites harmful requests into benign-looking ones, extracts detailed instructions from stronger VLMs, and then reintroduces the malicious content before execution. Its iterative refusal-feedback loop substantially raises attack success against Claude for Computer Use on real desktop and web tasks.

Open paper arXiv Report issue
Related papers (24)