SusBench: An Online Benchmark for Evaluating Dark Pattern Susceptibility of Computer-Use Agents

Longjie Guo , Chenjie Yuan , Mingyuan Zhong , Robert Wolfe , Ruican Zhong , Yue Xu , Bingbing Wen , Hua Shen , Lucy Lu Wang , Alexis Hiniker

🏛 Institutions: University of Washington , Rutgers University , CMU , New York University Shanghai
📅 Date: October 13, 2025
📑 Publisher: IUI 2026
💻 Env: Web
🔑 Keywords: benchmark dark patterns human-agent comparison code injections SusBench

TLDR

SusBench injects nine dark pattern types into 55 real consumer websites and evaluates five computer-use agents alongside 29 human participants across 313 tasks. It finds both agents and humans especially susceptible to preselection, trick wording, and hidden information, while other overt dark patterns are easier to resist.

Open paper arXiv Report issue