VPI-Bench: Visual Prompt Injection Attacks for Computer-Use Agents

Tri Cao , Bennett Lim , Yue Liu , Yuan Sui , Yuexin Li , Shumin Deng , Lin Lu , Nay Oo , Shuicheng Yan , Bryan Hooi

🏛 Institutions: NUS , Cyber Emerging Tech and R&D
📅 Date: June 3, 2025
📑 Publisher: ICLR 2026 (Poster)
💻 Env: Desktop
🔑 Keywords: benchmark visual prompt injection security attack browser-use agents VPI-Bench

TLDR

VPI-Bench studies visual prompt injection attacks on computer-use agents, where malicious instructions are embedded directly into rendered user interfaces rather than hidden in HTML. Across 306 cases on five platforms, it shows that both full-system-access CUAs and browser-use agents remain highly vulnerable, and that prompt-only defenses offer limited protection.

Open paper OpenReview Code Dataset Report issue