Automated Trajectory Evaluation for Mobile Agents via Step-Level Consequence Reasoning and Aggregation

This work automates mobile-agent trajectory evaluation by reasoning about the consequence of each step individually and aggregating step-level judgments into a trajectory-level verdict, rather than scoring only the final outcome.

• OSReward: Instituting Standardized Evaluation for Cross-Platform Computer-Use Reward Models
  July 30, 2026 · arXiv
• AndroidDaily: A Verifiable Benchmark for Mobile GUI Agents on Real-World Closed-Source Applications
  May 26, 2026 · arXiv
• Video-Based Reward Modeling for Computer-Use Agents
  March 10, 2026 · arXiv
• Auditing Web Agent Evaluation on WebArena-Lite: Human Review of Outcomes and Trajectories
  October 1, 2026 · NeurIPS 2026 Workshop on Who Verifies the Agents? Toward Reliable Agent Development
• SeekJudge: A Practical Reward Framework for Reinforcement Learning in Computer-Use Agents
  July 25, 2026 · arXiv
• AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectories
  April 11, 2025 · COLM 2025
• Large Language Models Can Self-Improve At Web Agent Tasks
  May 30, 2024 · arXiv
• Online Dense Reinforcement Learning with Planning-Grounding Agent for UI Navigation on Live IOS Apps
  October 29, 2026 · arXiv
• GUI-JEPA: Candidate-Conditioned JEPA Latents as a Fast Action Policy for Mobile GUI Agents
  October 27, 2026 · arXiv
• iPrefBench: A User-Centric Benchmark for Personalized Mobile Use Agents
  October 26, 2026 · arXiv
• Chart the Invisible: Interactive Perception for Hidden-Target Exploration in GUI Agents
  October 26, 2026 · arXiv
• AndroidFlux: Evaluating Failure Recovery and Recovery Action Reward Modeling in Mobile-Use Multimodal Agents
  October 25, 2026 · arXiv
• Subgoal-aware Memory Graph for GUI Agent
  October 22, 2026 · arXiv
• Reuse, Rewrite, or Reject: Evidence-Constrained Trace Reuse for Repeated Mobile GUI Control
  October 22, 2026 · arXiv
• Diagnosing Personalization Failures in Mobile GUI Agents
  October 22, 2026 · arXiv
• Tandem: Serving Hybrid Linear-Attention GUI Agents on Mobile NPUs
  October 19, 2026 · arXiv
• ScopeMem: Latent Memory That Learns Where to Revise Frozen GUI Agents
  October 19, 2026 · arXiv
• Beyond Next-Screen Prediction: The Decision Value of GUI World Models
  October 17, 2026 · arXiv
• MobileJailBench: Red Queen Jailbreak Benchmarking for Mobile Agents
  October 16, 2026 · arXiv
• MobileInject: Evaluating Reasoning-to-Action Security of MLLM-Based Mobile Agents under Cross-Modal Consistency Injection
  October 16, 2026 · arXiv
• Not All Graphs Are Maps: A Task-Agnostic Exploration Framework for Mobile GUI Navigation
  October 15, 2026 · arXiv
• MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer Environments
  October 14, 2026 · arXiv
• How GUI Agents Fail: GraceBench for Execution Stability Diagnosis
  October 14, 2026 · arXiv
• Learning How to Remember: Memory Modality Selection for GUI Agents
  October 13, 2026 · arXiv