MIP against Agent: Malicious Image Patches Hijacking Multimodal OS Agents

This paper shows that adversarial image patches embedded in on-screen content can hijack multimodal OS agents into harmful actions. The attacks transfer across prompts and screen configurations, exposing a visual attack surface that goes beyond text-only prompt injection.

• Mobile GUI Agents under Real-world Threats: Are We There Yet?
  July 6, 2025 · MobiSys 2026
• Towards Safe Autonomy for Computer Use
  October 13, 2026 · arXiv
• PrivacyGuard: Source-Linked Sanitization and Locally Resolvable PII References for Cloud GUI Agents
  October 12, 2026 · arXiv
• Secure-CUA: Controlling Untrusted Influence in Computer-Use Agents
  October 7, 2026 · arXiv
• AgentHijack: Visual Patch Attacks on Multimodal Computer-Use Agents
  September 6, 2026 · arXiv
• SIR: Self-improving Red-teaming for Compute Use Agents
  August 31, 2026 · arXiv
• The Blind Spot of Agent Safety: How Benign User Instructions Expose Critical Vulnerabilities in Computer-Use Agents
  April 12, 2026 · arXiv
• Preference Redirection via Attention Concentration: An Attack on Computer Use Agents
  April 9, 2026 · arXiv
• AgentSentinel: An End-to-End and Real-Time Security Defense Framework for Computer-Use Agents
  September 9, 2025 · CCS 2025
• VPI-Bench: Visual Prompt Injection Attacks for Computer-Use Agents
  June 3, 2025 · ICLR 2026 (Poster)
• RedTeamCUA: Realistic Adversarial Testing of Computer-Use Agents in Hybrid Web-OS Environments
  May 28, 2025 · ICLR 2026 (Oral)
• On the Robustness of GUI Grounding Models Against Image Attacks
  April 7, 2025 · arXiv
• sudo rm -rf agentic_security
  March 26, 2025 · ACL 2025 Industry Track
• In-Context Defense in Computer Agents: An Empirical Study
  March 12, 2025 · arXiv
• SkillLifeBench: Benchmarking Security Across the Lifecycle of Agent Skills
  October 26, 2026 · arXiv
• SPIDES: Information-Flow Control for Browser Agents
  October 16, 2026 · arXiv
• MobileJailBench: Red Queen Jailbreak Benchmarking for Mobile Agents
  October 16, 2026 · arXiv
• MobileInject: Evaluating Reasoning-to-Action Security of MLLM-Based Mobile Agents under Cross-Modal Consistency Injection
  October 16, 2026 · arXiv
• What It Is, Not What It Says: Securing Agentic Browsing Interactions with Web Semantics
  October 15, 2026 · arXiv
• MMA-SafetyBench: A Benchmark for Multimodal Agent Safety Evaluation
  October 14, 2026 · arXiv
• BrowseSafe++: Benchmarking Prompt Injection Detection Across Web Contexts, Languages, and Browser Views
  October 12, 2026 · arXiv
• The Agent Clicks Approve: Injected Page Text Makes Browser Agents Authorize Access the Task Never Named
  October 10, 2026 · arXiv
• AdvSim2Real : Training Web Agents Against Adaptive Prompt Injection in a Web World Model
  October 6, 2026 · arXiv
• Securing Computer-Use Agents Against Branch Steering Attacks
  October 2, 2026 · NeurIPS 2026 Workshop on Agents in the Wild