Who Verifies the Agent's Success Claim? Self-Report Leakage in GUI-Agent Completion Judging
Yunfeng Zhu , Shengcheng Yu , Zihan Li , Zhenyu Chen
- 🏛 Institutions
- NJU , TUM , Nanjing Normal University
- 📅 Date
- October 21, 2026
- 📑 Publisher
- arXiv
- 💻 Env
- General GUI
- 🔑 Keywords
TLDR
Investigates dangerous misreports where GUI agents falsely report success, identifying self-report leakage in completion judging and proposing independent verification to safeguard automation pipelines.
Related papers (24)
- Beyond Next-Screen Prediction: The Decision Value of GUI World ModelsOctober 17, 2026 · arXiv
- cua-speedrun: Standardized Benchmarking of the Speed of Computer-Use AgentsSeptember 30, 2026 · arXiv
- GUIDE: Interpretable GUI Agent Evaluation via Hierarchical DiagnosisApril 6, 2026 · arXiv
- GUI Agents: A SurveyDecember 18, 2024 · Findings of ACL 2025
- PersonaCUABench: Benchmarking Computer-Use Agents Serving Diverse PersonasOctober 16, 2026 · arXiv
- Interaction-as-a-JudgeOctober 13, 2026 · arXiv
- A Baseline Assessment for the Agentic Web Technology StackOctober 9, 2026 · arXiv
- AgentHorizon: Evaluating Agentic Judges for Long-Horizon Computer-Use TasksOctober 8, 2026 · arXiv
- Auditing Web Agent Evaluation on WebArena-Lite: Human Review of Outcomes and TrajectoriesOctober 1, 2026 · NeurIPS 2026 Workshop on Who Verifies the Agents? Toward Reliable Agent Development
- WebPageBench: Event-Level Verification and Controlled UI-Variant Generation for Web AgentsSeptember 28, 2026 · arXiv
- Same Outcomes, Different Journeys: A Trace-Level Framework for Comparing Human and GUI-Agent Behavior in Production Search SystemsApril 9, 2026 · arXiv
- CUAAudit: Meta-Evaluation of Vision-Language Models as Auditors of Autonomous Computer-Use AgentsMarch 11, 2026 · HEAL @ CHI 2026 Workshop
- MemGUI-Bench: Benchmarking Memory of Mobile GUI Agents in Dynamic EnvironmentsFebruary 3, 2026 · arXiv
- WebGraphEval: Multi-Turn Trajectory Evaluation for Web Agents using Graph RepresentationOctober 22, 2025 · NeurIPS 2025 Workshop on Multi-Turn Interactions in Large Language Models
- An Illusion of Progress? Assessing the Current State of Web AgentsApril 2, 2025 · COLM 2025
- Where to Learn and How Far to Roll Out: Efficient Adaptive Training for GUI AgentsOctober 29, 2026 · arXiv
- Right Click, Wrong Box: Grading GUI Grounding by What a Click DoesOctober 27, 2026 · arXiv
- Learning to Look Beyond Screens: Transferable Visual Observation from GUI GroundingOctober 27, 2026 · arXiv
- From Interaction to Capability: Task Advancement as State and Supervision for GUI AgentsOctober 27, 2026 · arXiv
- AdaGround: Token-Normalized Adaptive Zooming with Verifier-in-the-Loop Refinement for GUI GroundingOctober 27, 2026 · arXiv
- GUIFlow: Temporal Redundancy-Aware Incremental Inference for GUI AgentsOctober 26, 2026 · arXiv
- PreView: Enhancing GUI Grounding with Preprocessed Views and CuesOctober 24, 2026 · arXiv
- Build or Adopt? Custom-Built vs. General-Purpose LLM Agent Harnesses for Automotive GUI TestingOctober 24, 2026 · arXiv
- IGG: A Benchmark for Interactive GUI Grounding under Visibility ConstraintsOctober 23, 2026 · arXiv