World of Bits: An Open-Domain Platform for Web-Based Agents

World of Bits is an open-domain web environment where agents observe rendered webpages and DOM structure, then act with low-level keyboard and mouse commands. The paper also defines a methodology for building reproducible web tasks from real websites, including MiniWoB and QAWoB.

• Navigating WebAI: Training Agents to Complete Web Tasks with Large Language Models and Reinforcement Learning
  May 1, 2024 · SAC 2024
• Reinforcement Learning on Web Interfaces Using Workflow-Guided Exploration
  February 24, 2018 · ICLR 2018 (Poster)
• AndroidEnv: A Reinforcement Learning Platform for Android
  May 27, 2021 · arXiv
• WebArena-Infinity: Generating Browser Environments with Verifiable Tasks at Scale
  March 2026 · Blog Post
• WebFactory: Automated Compression of Foundational Language Intelligence into Grounded Web Agents
  March 5, 2026 · arXiv
• OpAgent: Operator Agent for Web Navigation
  February 14, 2026 · arXiv
• WebGym: Scaling Training Environments for Visual Web Agents with Realistic Tasks
  January 5, 2026 · arXiv
• WebServ: A Browser-Server Environment for Efficient Training of Reinforcement Learning-based Web Agents at Scale
  October 17, 2025 · arXiv
• Thinking vs. Doing: Agents that Reason by Scaling Test-Time Interaction
  June 9, 2025 · SEA @ NeurIPS 2025 (Oral)
• WebDancer: Towards Autonomous Information Seeking Agency
  May 28, 2025 · NeurIPS 2025 (Poster)
• WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learning
  May 22, 2025 · EMNLP 2025 (Poster)
• GUI-R1: A Generalist R1-Style Vision-Language Action Model for GUI Agents
  April 14, 2025 · arXiv
• Advancing Autonomous VLM Agents via Variational Subgoal-Conditioned Reinforcement Learning
  February 11, 2025 · arXiv
• Proposer-Agent-Evaluator (PAE): Autonomous Skill Discovery For Foundation Model Internet Agents
  December 17, 2024 · ICML 2025 (Poster)
• WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learning
  November 4, 2024 · ICLR 2025 (Poster)
• Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents
  August 13, 2024 · arXiv
• Grounded Language Agent for Product Search via Intelligent Web Interactions
  April 16, 2024 · CustomNLP4U @ NAACL 2024
• AutoWebGLM: A Large Language Model-based Web Navigating Agent
  April 4, 2024 · KDD 2024
• WebArena: A Realistic Web Environment for Building Autonomous Agents
  July 25, 2023 · ICLR 2024 (Poster)
• WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents
  July 31, 2022 · NeurIPS 2022
• GUI-C²: Coarse-to-Fine GUI Grounding via Difficulty-Aware Reinforcement Learning
  May 29, 2026 · arXiv
• MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research
  May 25, 2026 · arXiv
• LiteGUI: Distilling Compact GUI Agents with Reinforcement Learning
  May 8, 2026 · arXiv
• ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agents
  April 13, 2026 · arXiv