Navigating WebAI: Training Agents to Complete Web Tasks with Large Language Models and Reinforcement Learning
Lucas-Andreï Thil , Mirela Popa , Gerasimos Spanakis
- 🏛 Institutions
- Maastricht University
- 📅 Date
- May 1, 2024
- 📑 Publisher
- SAC 2024
- 💻 Env
- Web
- 🔑 Keywords
TLDR
Navigating WebAI studies web-task completion on MiniWoB with a training recipe that combines supervised learning and reinforcement learning. It also diagnoses that prior models often memorize shallow HTML cues instead of understanding structure, and reports stronger supervised baselines with less data while narrowing the gap to RL approaches.
Related papers (24)
- Reinforcement Learning on Web Interfaces Using Workflow-Guided ExplorationFebruary 24, 2018 · ICLR 2018 (Poster)
- World of Bits: An Open-Domain Platform for Web-Based AgentsAugust 31, 2017 · ICML 2017
- WebArena-Infinity: Generating Browser Environments with Verifiable Tasks at ScaleMarch 2026 · Blog Post
- WebFactory: Automated Compression of Foundational Language Intelligence into Grounded Web AgentsMarch 5, 2026 · arXiv
- OpAgent: Operator Agent for Web NavigationFebruary 14, 2026 · arXiv
- WebGym: Scaling Training Environments for Visual Web Agents with Realistic TasksJanuary 5, 2026 · arXiv
- WebServ: A Browser-Server Environment for Efficient Training of Reinforcement Learning-based Web Agents at ScaleOctober 17, 2025 · arXiv
- Thinking vs. Doing: Agents that Reason by Scaling Test-Time InteractionJune 9, 2025 · SEA @ NeurIPS 2025 (Oral)
- WebDancer: Towards Autonomous Information Seeking AgencyMay 28, 2025 · NeurIPS 2025 (Poster)
- WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement LearningMay 22, 2025 · EMNLP 2025 (Poster)
- GUI-R1: A Generalist R1-Style Vision-Language Action Model for GUI AgentsApril 14, 2025 · arXiv
- Advancing Autonomous VLM Agents via Variational Subgoal-Conditioned Reinforcement LearningFebruary 11, 2025 · arXiv
- Proposer-Agent-Evaluator (PAE): Autonomous Skill Discovery For Foundation Model Internet AgentsDecember 17, 2024 · ICML 2025 (Poster)
- WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement LearningNovember 4, 2024 · ICLR 2025 (Poster)
- Agent Q: Advanced Reasoning and Learning for Autonomous AI AgentsAugust 13, 2024 · arXiv
- Grounded Language Agent for Product Search via Intelligent Web InteractionsApril 16, 2024 · CustomNLP4U @ NAACL 2024
- AutoWebGLM: A Large Language Model-based Web Navigating AgentApril 4, 2024 · KDD 2024
- GUI-C²: Coarse-to-Fine GUI Grounding via Difficulty-Aware Reinforcement LearningMay 29, 2026 · arXiv
- MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent ResearchMay 25, 2026 · arXiv
- LiteGUI: Distilling Compact GUI Agents with Reinforcement LearningMay 8, 2026 · arXiv
- ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI AgentsApril 13, 2026 · arXiv
- Android Coach: Improve Online Agentic Training Efficiency with Single State Multiple ActionsApril 8, 2026 · arXiv
- Don't Act Blindly: Robust GUI Automation via Action-Effect Verification and Self-CorrectionApril 7, 2026 · ACL 2026
- UI-Voyager: A Self-Evolving GUI Agent Learning via Failed ExperienceMarch 25, 2026 · arXiv