Agentic Reward Modeling: Verifying GUI Agent via Online Proactive Interaction

Chaoqun Cui , Jing Huang , Shijing Wang , Liming Zheng , Qingchao Kong , Zhixiong Zeng

🏛 Institutions: Institute of Automation , CAS , University of Chinese Academy of Sciences , Meituan , Beijing Jiaotong University
📅 Date: January 31, 2026
📑 Publisher: arXiv
💻 Env: General GUI
🔑 Keywords: reward modeling verification proactive interaction VAGEN OSWorld AndroidWorld

TLDR

VAGEN turns GUI-agent verification into an active interaction problem, using a verifier agent to probe the environment for evidence of task completion instead of relying on passive judgment. This substantially improves verification accuracy on OSWorld and AndroidWorld.

Open paper Code Report issue

Related papers (24)

STEP: Success-Rate-Aware Trajectory-Efficient Policy Optimization

November 17, 2025 · Findings of ACL 2026
Agent Alpha: Tree Search Unifying Generation, Exploration and Evaluation for Computer-Use Agents

February 3, 2026 · arXiv
BEAP-Agent: Backtrackable Execution and Adaptive Planning for GUI Agents

January 29, 2026 · arXiv
From Off-Policy to On-Policy: Enhancing GUI Agents via Bi-level Expert-to-Policy Assimilation

January 9, 2026 · arXiv
R-WoM: Retrieval-augmented World Model For Computer-use Agents

October 13, 2025 · ICLR 2026 (Poster)
Just Do It!? Computer-Use Agents Exhibit Blind Goal-Directedness

October 2, 2025 · ICLR 2026 (Poster)
Agent S2: A Compositional Generalist-Specialist Framework for Computer Use Agents

April 1, 2025 · COLM 2025
BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agents

September 11, 2026 · arXiv
Are Android GUI Agents Robust Against Runtime Anomalies? AnTrap: Evaluating Agents in Dynamic Adversarial Environments

August 25, 2026 · arXiv
StateAct: Program State, before Pixels, for Long-Horizon Computer-Use Agents

July 24, 2026 · arXiv
StructAgent: Harness Long-horizon Digital Agents with Unified Causal Structure

July 13, 2026 · arXiv
SE-GA: Memory-Augmented Self-Evolution for GUI Agents

May 16, 2026 · ICML 2026
IntentScore: Intent-Conditioned Action Evaluation for Computer-Use Agents

April 6, 2026 · arXiv
The Art of Building Verifiers for Computer Use Agents

April 5, 2026 · arXiv
GUIDE: Resolving Domain Bias in GUI Agents through Real-Time Web Video Retrieval and Plug-and-Play Annotation

March 27, 2026 · arXiv
UI-Voyager: A Self-Evolving GUI Agent Learning via Failed Experience

March 25, 2026 · arXiv
ContractSkill: Repairable Contract-Based Skills for Multimodal Web Agents

March 20, 2026 · arXiv
HATS: Hardness-Aware Trajectory Synthesis for GUI Agents

March 12, 2026 · CVPR 2026
Adaptive Milestone Reward for GUI Agents

February 12, 2026 · arXiv
ANCHOR: Branch-Point Data Generation for GUI Agents

February 6, 2026 · arXiv
EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experience

January 22, 2026 · arXiv
CaMeLs Can Use Computers Too: System-level Security for Computer Use Agents

January 14, 2026 · arXiv
Watch and Learn: Learning to Use Computers from Online Videos

October 6, 2025 · CVPR 2026
Scaling Agents for Computer Use

October 2, 2025 · arXiv