From Off-Policy to On-Policy: Enhancing GUI Agents via Bi-level Expert-to-Policy Assimilation

BEPA improves end-to-end GUI-agent training with verifiable rewards by turning scarce off-policy expert traces into policy-aligned guidance through self-rolled reachable trajectories and a dynamically updated per-task cache. On OSWorld-Verified it raises UI-TARS-1.5-7B from 22.87% to 32.13%, with additional gains on MMBench-GUI and Online-Mind2Web.

• OS-Helix: Unifying GUI Interaction and Code Execution in Native Computer-Using Agents
  October 15, 2026 · arXiv
• MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer Environments
  October 14, 2026 · arXiv
• HybridCUA: Learning to Orchestrate GUI and CLI for Computer-Use Agents
  September 29, 2026 · arXiv
• STEP: Success-Rate-Aware Trajectory-Efficient Policy Optimization
  November 17, 2025 · Findings of ACL 2026
• Efficient Multi-turn RL for GUI Agents via Decoupled Training and Adaptive Data Curation
  September 28, 2025 · arXiv
• ComputerRL: Scaling End-to-End Online Reinforcement Learning for Computer Use Agents
  August 19, 2025 · ICLR 2026 (Poster)
• Where to Learn and How Far to Roll Out: Efficient Adaptive Training for GUI Agents
  October 29, 2026 · arXiv
• Agent World Model in the Wild: Computer-Use Agent Environment Synthesis
  October 19, 2026 · arXiv
• GroundGUI: GUI Grounding by High-Quality Data and Distillation-to-Reinforcement Learning
  October 13, 2026 · arXiv
• SCA: Spatial Credit Assignment for Reinforcement Learning of GUI Agents
  September 29, 2026 · arXiv
• Task-Adaptive Rubrics for GUI Reward Modeling
  August 25, 2026 · arXiv
• Beyond Success and Failure: Length-Aware Contrastive Learning for GUI Agents
  August 22, 2026 · arXiv
• GUI-C²: Coarse-to-Fine GUI Grounding via Difficulty-Aware Reinforcement Learning
  May 29, 2026 · arXiv
• LiteGUI: Distilling Compact GUI Agents with Reinforcement Learning
  May 8, 2026 · arXiv
• OS-Themis: A Scalable Critic Framework for Generalist GUI Rewards
  March 19, 2026 · arXiv
• CGL: Advancing Continual GUI Learning via Reinforcement Fine-Tuning
  March 3, 2026 · arXiv
• GUI-Libra: Training Native GUI Agents to Reason and Act with Action-aware Supervision and Partially Verifiable RL
  February 25, 2026 · arXiv
• Building Autonomous GUI Navigation via Agentic-Q Estimation and Step-Wise Policy Optimization
  February 14, 2026 · arXiv
• Autonomous Continual Learning of Computer-Use Agents for Environment Adaptation
  February 10, 2026 · arXiv
• Agent Alpha: Tree Search Unifying Generation, Exploration and Evaluation for Computer-Use Agents
  February 3, 2026 · arXiv
• Agentic Reward Modeling: Verifying GUI Agent via Online Proactive Interaction
  January 31, 2026 · arXiv
• SSL: Sweet Spot Learning for Differentiated Guidance in Agentic Optimization
  January 30, 2026 · arXiv
• BEAP-Agent: Backtrackable Execution and Adaptive Planning for GUI Agents
  January 29, 2026 · arXiv
• GUI-Eyes: Tool-Augmented Perception for Visual Grounding in GUI Agents
  January 14, 2026 · arXiv