Navigating WebAI: Training Agents to Complete Web Tasks with Large Language Models and Reinforcement Learning
Lucas-Andreï Thil , Mirela Popa , Gerasimos Spanakis
- 🏛 Institutions
- Maastricht University
- 📅 Date
- May 1, 2024
- 📑 Publisher
- SAC 2024
- 💻 Env
- Web
- 🔑 Keywords
TLDR
Navigating WebAI studies web-task completion on MiniWoB with a training recipe that combines supervised learning and reinforcement learning. It also diagnoses that prior models often memorize shallow HTML cues instead of understanding structure, and reports stronger supervised baselines with less data while narrowing the gap to RL approaches.
Related papers (24)
- Reinforcement Learning on Web Interfaces Using Workflow-Guided ExplorationFebruary 24, 2018 · ICLR 2018 (Poster)
- World of Bits: An Open-Domain Platform for Web-Based AgentsAugust 31, 2017 · ICML 2017
- Adaptive-Group Process Rewards for GUI AgentsOctober 13, 2026 · arXiv
- In-Context Teacher–Student Guidance for Open-Weight Browser AgentsSeptember 2026 · KDMiLe 2026
- Action Conditioned Bisimulation For GUI Agent MemorySeptember 30, 2026 · arXiv
- CUA-Sandbox: Efficient Environments for Computer-Use Agent Reinforcement LearningSeptember 26, 2026 · arXiv
- CaptchaArena: A Large-Scale, Fine-Grained Dataset for Training Computer-Use Agents on Interactive CAPTCHAsSeptember 25, 2026 · arXiv
- MintAct: A Unified Visual Agent for Digital EnvironmentsSeptember 18, 2026 · arXiv
- SCALECUA: Scaling Computer Use Agents with Verifiable Task Synthesis and Efficient Online RLJuly 13, 2026 · arXiv
- WebArena-Infinity: Generating Browser Environments with Verifiable Tasks at ScaleMarch 2026 · Blog Post
- WebFactory: Automated Compression of Foundational Language Intelligence into Grounded Web AgentsMarch 5, 2026 · arXiv
- OpAgent: Operator Agent for Web NavigationFebruary 14, 2026 · arXiv
- Web Agent Agentic Reinforcement Learning Decision Model Under Multi-Cost and Failure RiskJanuary 12, 2026 · arXiv
- WebGym: Scaling Training Environments for Visual Web Agents with Realistic TasksJanuary 5, 2026 · arXiv
- WebServ: A Browser-Server Environment for Efficient Training of Reinforcement Learning-based Web Agents at ScaleOctober 17, 2025 · arXiv
- Thinking vs. Doing: Agents that Reason by Scaling Test-Time InteractionJune 9, 2025 · SEA @ NeurIPS 2025 (Oral)
- WebDancer: Towards Autonomous Information Seeking AgencyMay 28, 2025 · NeurIPS 2025 (Poster)
- WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement LearningMay 22, 2025 · EMNLP 2025 (Poster)
- GUI-R1: A Generalist R1-Style Vision-Language Action Model for GUI AgentsApril 14, 2025 · arXiv
- Advancing Autonomous VLM Agents via Variational Subgoal-Conditioned Reinforcement LearningFebruary 11, 2025 · arXiv
- Proposer-Agent-Evaluator (PAE): Autonomous Skill Discovery For Foundation Model Internet AgentsDecember 17, 2024 · ICML 2025 (Poster)
- WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement LearningNovember 4, 2024 · ICLR 2025 (Poster)
- Agent Q: Advanced Reasoning and Learning for Autonomous AI AgentsAugust 13, 2024 · arXiv
- Grounded Language Agent for Product Search via Intelligent Web InteractionsApril 16, 2024 · CustomNLP4U @ NAACL 2024