How GUI Agents Fail: GraceBench for Execution Stability Diagnosis

Introduces GraceBench, an online evaluation benchmark that maps mobile apps as UI Transition Graphs (UTGs) to diagnose step-level execution stability, measuring deviation, loop burden, and recovery dynamics beyond binary task success.

• iPrefBench: A User-Centric Benchmark for Personalized Mobile Use Agents
  October 26, 2026 · arXiv
• AndroidFlux: Evaluating Failure Recovery and Recovery Action Reward Modeling in Mobile-Use Multimodal Agents
  October 25, 2026 · arXiv
• MobileJailBench: Red Queen Jailbreak Benchmarking for Mobile Agents
  October 16, 2026 · arXiv
• MobileInject: Evaluating Reasoning-to-Action Security of MLLM-Based Mobile Agents under Cross-Modal Consistency Injection
  October 16, 2026 · arXiv
• Not All Graphs Are Maps: A Task-Agnostic Exploration Framework for Mobile GUI Navigation
  October 15, 2026 · arXiv
• OpenMobile-2: Building Versatile Mobile Agents with Scalable Environments and App-Native Tools
  October 9, 2026 · arXiv
• Same Tasks, Different Apps: Why Mobile GUI Agents Fail to Generalize?
  September 28, 2026 · Findings of EMNLP 2026
• Constructing Challenging Browser-Use Tasks by Controlled Environment Interventions
  September 20, 2026 · arXiv
• SecureWebArena: A Holistic Security Evaluation Benchmark for LVLM-based Web Agents
  October 11, 2025 · arXiv
• WebSuite: Systematically Evaluating Why Web Agents Fail
  June 1, 2024 · arXiv
• Online Dense Reinforcement Learning with Planning-Grounding Agent for UI Navigation on Live IOS Apps
  October 29, 2026 · arXiv
• GUI-JEPA: Candidate-Conditioned JEPA Latents as a Fast Action Policy for Mobile GUI Agents
  October 27, 2026 · arXiv
• Chart the Invisible: Interactive Perception for Hidden-Target Exploration in GUI Agents
  October 26, 2026 · arXiv
• Tandem: Serving Hybrid Linear-Attention GUI Agents on Mobile NPUs
  October 19, 2026 · arXiv
• MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer Environments
  October 14, 2026 · arXiv
• Can Agents Work for Everyone? Cross-User Reliability for Mobile GUI Agents in Personalized User Interfaces
  October 6, 2026 · arXiv
• GUITAR: Structured Failure Diagnosis of GUI Agents via State Transitions
  September 28, 2026 · arXiv
• MATE: Policy-Aware Security Auditing for Mobile Agents via Synthesis-Driven Trajectory Learning
  September 19, 2026 · USENIX Security 2026
• RecreationWorld: Scalable and Verifiable Environments for Hybrid Computer-Use Agents
  September 18, 2026 · arXiv
• PriMobiBench: Characterizing Visual Privacy Leakage in VLM-Driven Mobile GUI Agents
  September 12, 2026 · arXiv
• JarvisGUI: Towards Cross-Device GUI Agents with Dynamic Task Composition
  September 9, 2026 · arXiv
• APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agents
  September 7, 2026 · arXiv
• ElderBench: Benchmarking Autonomous Mobile Agents for Older Adults
  September 4, 2026 · arXiv
• GUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent Environments
  August 30, 2026 · arXiv