CAVEAT: Towards Robust Computer-Use Agents in Incentive-Misaligned Environments

Yuxuan Li , Will Epperson , Wesley Deng , Zezhou Huang

🏛 Institutions: CMU , MSR
📅 Date: September 23, 2026
📑 Publisher: arXiv
💻 Env: Web
🔑 Keywords: CAVEAT CAVEAT-Harness benchmark incentive robustness

TLDR

CAVEAT is a benchmark of nine marketplace environments and eight steering mechanisms that tests whether computer-use agents keep the user's objective when the environment itself has a stake in the outcome. Agents buy the user-optimal product in 78.6% of matched-control episodes but only 17.3% when steering is enabled, and CAVEAT-Harness, which targets the diagnosed failure modes, raises user-optimal purchasing by 55.0%.

Open paper Report issue