Automated Trajectory Evaluation for Mobile Agents via Step-Level Consequence Reasoning and Aggregation

This work automates mobile-agent trajectory evaluation by reasoning about the consequence of each step individually and aggregating step-level judgments into a trajectory-level verdict, rather than scoring only the final outcome.

• OSReward: Instituting Standardized Evaluation for Cross-Platform Computer-Use Reward Models
  July 30, 2026 · arXiv
• AndroidDaily: A Verifiable Benchmark for Mobile GUI Agents on Real-World Closed-Source Applications
  May 26, 2026 · arXiv
• Video-Based Reward Modeling for Computer-Use Agents
  March 10, 2026 · arXiv
• SeekJudge: A Practical Reward Framework for Reinforcement Learning in Computer-Use Agents
  July 25, 2026 · arXiv
• AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectories
  April 11, 2025 · COLM 2025
• Large Language Models Can Self-Improve At Web Agent Tasks
  May 30, 2024 · arXiv
• BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agents
  September 11, 2026 · arXiv
• JarvisGUI: Towards Cross-Device GUI Agents with Dynamic Task Composition
  September 9, 2026 · arXiv
• APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agents
  September 7, 2026 · arXiv
• Improving Proficiency and Efficiency of Android GUI Agents via Self-Generating Tool Actions
  September 6, 2026 · arXiv
• ElderBench: Benchmarking Autonomous Mobile Agents for Older Adults
  September 4, 2026 · arXiv
• WiP: Characterizing and Defending Against Mobile-Agent-Driven MFA Automation
  September 2, 2026 · arXiv
• GUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent Environments
  August 30, 2026 · arXiv
• ActReal: System-Level Mobile Agents Challenge Mobile Automation Detection
  August 30, 2026 · arXiv
• WM-R1: Training GUI Agents to Reason and leverage World Models with Reinforcement Learning
  August 27, 2026 · arXiv
• Are Android GUI Agents Robust Against Runtime Anomalies? AnTrap: Evaluating Agents in Dynamic Adversarial Environments
  August 25, 2026 · arXiv
• ADeptS-Bench: Measuring the Trustworthiness of Computer Use Agents Across Devices
  August 25, 2026 · arXiv
• GSAR: Goal-State-Anchor Rewards for Mobile GUI Agents with Self-Evolving Data Synthesis
  August 24, 2026 · arXiv
• Lexical Coupling in GUI Element Grounding: Sentence Embeddings Track Labels across Mobile and Web
  August 22, 2026 · arXiv
• Benchmarking General Mobile Assistants in Challenging Real-World Scenarios
  August 21, 2026 · arXiv
• MobileWorldSafety: Benchmarking GUI Agent Safety Against Environmental Injection Attacks in Android Apps
  August 18, 2026 · arXiv
• CoAdapt-GUI: Joint Workflow Context and Policy Adaptation for Unseen GUI Applications
  August 12, 2026 · arXiv
• The Next Screenshot Knows: Gated Hindsight Distillation for Mobile GUI Agents
  August 6, 2026 · arXiv
• StepReflect: Structured UI Transition Reflection for Mobile GUI Agents
  August 6, 2026 · arXiv