APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agents

APPSim-Bench provides 557 tasks across 17 high-frequency Chinese and English apps, rebuilt as controllable simulated apps that preserve interaction logic while removing stochasticity from ads, recommendations, and accounts, and evaluates 19 GUI agents on them.

• REAL: Benchmarking Autonomous Agents on Deterministic Simulations of Real Websites
  April 15, 2025 · arXiv
• iPrefBench: A User-Centric Benchmark for Personalized Mobile Use Agents
  October 26, 2026 · arXiv
• AndroidFlux: Evaluating Failure Recovery and Recovery Action Reward Modeling in Mobile-Use Multimodal Agents
  October 25, 2026 · arXiv
• MobileJailBench: Red Queen Jailbreak Benchmarking for Mobile Agents
  October 16, 2026 · arXiv
• MobileInject: Evaluating Reasoning-to-Action Security of MLLM-Based Mobile Agents under Cross-Modal Consistency Injection
  October 16, 2026 · arXiv
• Not All Graphs Are Maps: A Task-Agnostic Exploration Framework for Mobile GUI Navigation
  October 15, 2026 · arXiv
• MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer Environments
  October 14, 2026 · arXiv
• How GUI Agents Fail: GraceBench for Execution Stability Diagnosis
  October 14, 2026 · arXiv
• OpenMobile-2: Building Versatile Mobile Agents with Scalable Environments and App-Native Tools
  October 9, 2026 · arXiv
• Can Agents Work for Everyone? Cross-User Reliability for Mobile GUI Agents in Personalized User Interfaces
  October 6, 2026 · arXiv
• Same Tasks, Different Apps: Why Mobile GUI Agents Fail to Generalize?
  September 28, 2026 · Findings of EMNLP 2026
• MATE: Policy-Aware Security Auditing for Mobile Agents via Synthesis-Driven Trajectory Learning
  September 19, 2026 · USENIX Security 2026
• RecreationWorld: Scalable and Verifiable Environments for Hybrid Computer-Use Agents
  September 18, 2026 · arXiv
• PriMobiBench: Characterizing Visual Privacy Leakage in VLM-Driven Mobile GUI Agents
  September 12, 2026 · arXiv
• JarvisGUI: Towards Cross-Device GUI Agents with Dynamic Task Composition
  September 9, 2026 · arXiv
• ElderBench: Benchmarking Autonomous Mobile Agents for Older Adults
  September 4, 2026 · arXiv
• GUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent Environments
  August 30, 2026 · arXiv
• Are Android GUI Agents Robust Against Runtime Anomalies? AnTrap: Evaluating Agents in Dynamic Adversarial Environments
  August 25, 2026 · arXiv
• ADeptS-Bench: Measuring the Trustworthiness of Computer Use Agents Across Devices
  August 25, 2026 · arXiv
• Benchmarking General Mobile Assistants in Challenging Real-World Scenarios
  August 21, 2026 · arXiv
• OSReward: Instituting Standardized Evaluation for Cross-Platform Computer-Use Reward Models
  July 30, 2026 · arXiv
• Benchmarking Living-Screen-Native GUI Agents on Short-Video Platforms
  June 3, 2026 · arXiv
• Scaling, Benchmarking, and Reasoning of Vision-Language Agents for Mobile GUI Navigation
  May 26, 2026 · ICML 2026 (Poster)
• AndroidDaily: A Verifiable Benchmark for Mobile GUI Agents on Real-World Closed-Source Applications
  May 26, 2026 · arXiv