AgentDAM: Privacy Leakage Evaluation for Autonomous Web Agents
Arman Zharmagambetov , Chuan Guo , Ivan Evtimov , Maya Pavlova , Ruslan Salakhutdinov , Kamalika Chaudhuri
- 🏛 Institutions
- FAIR at Meta , Meta
- 📅 Date
- March 12, 2025
- 📑 Publisher
- NeurIPS 2025 Datasets and Benchmarks Track (Poster)
- 💻 Env
- Web
- 🔑 Keywords
TLDR
AgentDAM is an end-to-end web benchmark for testing whether autonomous agents obey data minimization and avoid accessing sensitive information unless it is necessary for the task. It shows that current agents frequently over-consume private data, while a prompting-based defense can reduce leakage.
Related papers (24)
- AgentTell: Behavioural Side-Channel Leakage in Browser-Use AgentsSeptember 26, 2026 · arXiv
- WebSP-Eval: Evaluating Web Agents on Website Security and Privacy TasksApril 7, 2026 · arXiv
- WebPII: Benchmarking Visual PII Detection for Computer-Use AgentsMarch 18, 2026 · arXiv
- PriMobiBench: Characterizing Visual Privacy Leakage in VLM-Driven Mobile GUI AgentsSeptember 12, 2026 · arXiv
- AgentHeal: Evaluating Goal-Preserving Resource Recovery of Web Agents under Access BarriersOctober 29, 2026 · arXiv
- SkillLifeBench: Benchmarking Security Across the Lifecycle of Agent SkillsOctober 26, 2026 · arXiv
- AgentProofBench: Benchmarking Reusable Verifiers for Web AgentsOctober 25, 2026 · arXiv
- SkillShift-Bench: Benchmarking Skill Learning under Environment Evolution for Web AgentsOctober 24, 2026 · arXiv
- LoWAgent: A Low-Resource Multilingual Benchmark for Web AgentsOctober 19, 2026 · arXiv
- PrivacyGuard: Source-Linked Sanitization and Locally Resolvable PII References for Cloud GUI AgentsOctober 12, 2026 · arXiv
- BrowseSafe++: Benchmarking Prompt Injection Detection Across Web Contexts, Languages, and Browser ViewsOctober 12, 2026 · arXiv
- When Charts Deceive Web Agents: A Paired Benchmark for Misleading Visualization-Grounded TasksOctober 9, 2026 · arXiv
- A Baseline Assessment for the Agentic Web Technology StackOctober 9, 2026 · arXiv
- AgentHorizon: Evaluating Agentic Judges for Long-Horizon Computer-Use TasksOctober 8, 2026 · arXiv
- PlaySuite: A Large-Scale Benchmark for Interactive Visual IntelligenceOctober 5, 2026 · arXiv
- Securing Computer-Use Agents Against Branch Steering AttacksOctober 2, 2026 · NeurIPS 2026 Workshop on Agents in the Wild
- AdaptArena: Evaluating Test-Time Personalization of Web AgentsSeptember 29, 2026 · arXiv
- WebPageBench: Event-Level Verification and Controlled UI-Variant Generation for Web AgentsSeptember 28, 2026 · arXiv
- DashAct: A Progressive Diagnostic Benchmark for GUI Agents in Interactive Dashboard AnalysisSeptember 26, 2026 · arXiv
- The Hard Part Comes After Search: Benchmarking Web Agents on Synthesizing, Organizing, and Displaying KnowledgeSeptember 24, 2026 · Findings of EMNLP 2026
- Invisible in Space, Visible in Time: Motion Vision CAPTCHA against GUI AgentsSeptember 23, 2026 · ACM MM 2026
- Guides That Cause Actions: An Offline Study of Guide-Action Mutual Reinforcement in Multimodal Web AgentsSeptember 23, 2026 · arXiv
- CAVEAT: Towards Robust Computer-Use Agents in Incentive-Misaligned EnvironmentsSeptember 23, 2026 · arXiv
- Constructing Challenging Browser-Use Tasks by Controlled Environment InterventionsSeptember 20, 2026 · arXiv