WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learning

WebAgent-R1 studies end-to-end multi-turn reinforcement learning for web agents rather than single-turn reasoning tasks. It learns directly from online browser interactions with binary success rewards and substantially improves small open models on WebArena-Lite, surpassing prior methods and some proprietary baselines.

• Agentic Test-Time Scaling for WebAgents
  February 12, 2026 · arXiv
• Adaptive-Group Process Rewards for GUI Agents
  October 13, 2026 · arXiv
• Harness Evolution Hits a Ceiling: When Weight Training Should Begin
  October 8, 2026 · arXiv
• CLIFT: Conformal Self-Verification for Web Agent Training and Test-Time Scaling
  October 5, 2026 · arXiv
• Auditing Web Agent Evaluation on WebArena-Lite: Human Review of Outcomes and Trajectories
  October 1, 2026 · NeurIPS 2026 Workshop on Who Verifies the Agents? Toward Reliable Agent Development
• From Trajectories to Grounded Preferences: Process Preference Synthesis via Interaction Element Graphs for Web PRMs
  September 26, 2026 · arXiv
• CUA-Sandbox: Efficient Environments for Computer-Use Agent Reinforcement Learning
  September 26, 2026 · arXiv
• CaptchaArena: A Large-Scale, Fine-Grained Dataset for Training Computer-Use Agents on Interactive CAPTCHAs
  September 25, 2026 · arXiv
• MintAct: A Unified Visual Agent for Digital Environments
  September 18, 2026 · arXiv
• SCALECUA: Scaling Computer Use Agents with Verifiable Task Synthesis and Efficient Online RL
  July 13, 2026 · arXiv
• WebArena-Infinity: Generating Browser Environments with Verifiable Tasks at Scale
  March 2026 · Blog Post
• WebFactory: Automated Compression of Foundational Language Intelligence into Grounded Web Agents
  March 5, 2026 · arXiv
• OpAgent: Operator Agent for Web Navigation
  February 14, 2026 · arXiv
• Web Agent Agentic Reinforcement Learning Decision Model Under Multi-Cost and Failure Risk
  January 12, 2026 · arXiv
• WebGym: Scaling Training Environments for Visual Web Agents with Realistic Tasks
  January 5, 2026 · arXiv
• WebATLAS: An LLM Agent with Experience-Driven Memory and Action Simulation
  October 26, 2025 · NeurIPS 2025 Workshop on Language Agents and World Models
• WebServ: A Browser-Server Environment for Efficient Training of Reinforcement Learning-based Web Agents at Scale
  October 17, 2025 · arXiv
• JEF-Hinter: Leveraging Offline Knowledge for Improving Web Agents Adaptation
  October 5, 2025 · arXiv
• Test‑Time Reinforcement Learning for GUI Grounding via Region Consistency
  August 7, 2025 · AAAI 2026
• Thinking vs. Doing: Agents that Reason by Scaling Test-Time Interaction
  June 9, 2025 · SEA @ NeurIPS 2025 (Oral)
• WebDancer: Towards Autonomous Information Seeking Agency
  May 28, 2025 · NeurIPS 2025 (Poster)
• ReGUIDE: Data Efficient GUI Grounding via Spatial Reasoning and Search
  May 21, 2025 · arXiv
• GUI-R1: A Generalist R1-Style Vision-Language Action Model for GUI Agents
  April 14, 2025 · arXiv
• Advancing Autonomous VLM Agents via Variational Subgoal-Conditioned Reinforcement Learning
  February 11, 2025 · arXiv