Android Coach: Improve Online Agentic Training Efficiency with Single State Multiple Actions

Android Coach shifts online RL training from Single State Single Action to Single State Multiple Actions by learning a critic that estimates action values and integrating a process reward model with group-wise advantage estimation. It improves UI-TARS-1.5-7B by 7.5% on AndroidLab and 8.3% on AndroidWorld with 1.4x higher training efficiency than PPO and GRPO.

• GSAR: Goal-State-Anchor Rewards for Mobile GUI Agents with Self-Evolving Data Synthesis
  August 24, 2026 · arXiv
• ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agents
  April 13, 2026 · arXiv
• Where to Learn and How Far to Roll Out: Efficient Adaptive Training for GUI Agents
  October 29, 2026 · arXiv
• VeriCUA: Learning Proactive Verification for Reliable GUI Agent Rewards
  October 19, 2026 · arXiv
• From Trajectories to Grounded Preferences: Process Preference Synthesis via Interaction Element Graphs for Web PRMs
  September 26, 2026 · arXiv
• Task-Adaptive Rubrics for GUI Reward Modeling
  August 25, 2026 · arXiv
• SeekJudge: A Practical Reward Framework for Reinforcement Learning in Computer-Use Agents
  July 25, 2026 · arXiv
• OS-Themis: A Scalable Critic Framework for Generalist GUI Rewards
  March 19, 2026 · arXiv
• CUARewardBench: A Benchmark for Evaluating Reward Models on Computer-using Agent
  October 21, 2025 · arXiv
• ProgRM: Build Better GUI Agents with Progress Rewards
  May 23, 2025 · arXiv
• Online Dense Reinforcement Learning with Planning-Grounding Agent for UI Navigation on Live IOS Apps
  October 29, 2026 · arXiv
• AndroidFlux: Evaluating Failure Recovery and Recovery Action Reward Modeling in Mobile-Use Multimodal Agents
  October 25, 2026 · arXiv
• MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer Environments
  October 14, 2026 · arXiv
• Adaptive-Group Process Rewards for GUI Agents
  October 13, 2026 · arXiv
• MintAct: A Unified Visual Agent for Digital Environments
  September 18, 2026 · arXiv
• WM-R1: Training GUI Agents to Reason and leverage World Models with Reinforcement Learning
  August 27, 2026 · arXiv
• Are Android GUI Agents Robust Against Runtime Anomalies? AnTrap: Evaluating Agents in Dynamic Adversarial Environments
  August 25, 2026 · arXiv
• OSReward: Instituting Standardized Evaluation for Cross-Platform Computer-Use Reward Models
  July 30, 2026 · arXiv
• MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research
  May 25, 2026 · arXiv
• Don't Act Blindly: Robust GUI Automation via Action-Effect Verification and Self-Correction
  April 7, 2026 · ACL 2026
• UI-Voyager: A Self-Evolving GUI Agent Learning via Failed Experience
  March 25, 2026 · arXiv
• Video-Based Reward Modeling for Computer-Use Agents
  March 10, 2026 · arXiv
• Generalization in Online Reinforcement Learning for Mobile Agents
  March 8, 2026 · arXiv
• Adaptive Milestone Reward for GUI Agents
  February 12, 2026 · arXiv