Routing Is Least Learnable Where It Is Most Valuable: Bounds on Representation Routing for Web Agents
Jiaming Wei , Zekun Wu , Adriano Koshiyama , Maria Perez-Ortiz
- 🏛 Institutions
- Unknown
- 📅 Date
- August 6, 2026
- 📑 Publisher
- arXiv
- 💻 Env
- Web
- 🔑 Keywords
TLDR
This paper measures when web agents should use text, pixels, or both. Repeated runs show that apparent oracle routing gains are heavily affected by execution noise; learned routers do not consistently beat a fixed mode, while unsolved-task routing can still reduce cost without lowering success.
Related papers (24)
- WALT: Web Agents that Learn ToolsOctober 1, 2025 · ICLR 2026 (Poster)
- Online Skill Learning for Web Agents via State-Grounded Dynamic RetrievalJune 3, 2026 · arXiv
- The Tool Illusion: Rethinking Tool Use in Web AgentsApril 3, 2026 · arXiv
- When Users Change Their Mind: Evaluating Interruptible Agents in Long-Horizon Web NavigationApril 1, 2026 · arXiv
- WebArena-Infinity: Generating Browser Environments with Verifiable Tasks at ScaleMarch 2026 · Blog Post
- AI Planning Framework for LLM-Based Web AgentsMarch 13, 2026 · arXiv
- HATS: Hardness-Aware Trajectory Synthesis for GUI AgentsMarch 12, 2026 · CVPR 2026
- WebWorld: A Large-Scale World Model for Web Agent TrainingFebruary 16, 2026 · arXiv
- OpAgent: Operator Agent for Web NavigationFebruary 14, 2026 · arXiv
- DynaWeb: Model-Based Reinforcement Learning of Web AgentsJanuary 29, 2026 · arXiv
- ColorBrowserAgent: Complex Long-Horizon Browser Agent with Adaptive Knowledge EvolutionJanuary 12, 2026 · arXiv
- WebOperator: Action-Aware Tree Search for Autonomous Agents in Web EnvironmentDecember 14, 2025 · arXiv
- Go-Browse: Training Web Agents with Structured ExplorationJune 4, 2025 · ICLR 2026 (Poster)
- Inducing Programmatic Skills for Agentic TasksApril 9, 2025 · COLM 2025
- Attacking Vision-Language Computer Agents via Pop-upsNovember 4, 2024 · ACL 2025
- Beyond Browsing: API-Based Web AgentsOctober 24, 2024 · Findings of ACL 2025
- ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory LearningOctober 2, 2024 · ICLR 2025 (Poster)
- Tree Search for Language Model AgentsJuly 1, 2024 · TMLR 2025
- Dissecting Adversarial Robustness of Multimodal LM AgentsJune 18, 2024 · ICLR 2025 (Poster)
- Large Language Models Can Self-Improve At Web Agent TasksMay 30, 2024 · arXiv
- VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web TasksJanuary 24, 2024 · ACL 2024
- SteP: Stacked LLM Policies for Web ActionsOctober 5, 2023 · COLM 2024
- WebArena: A Realistic Web Environment for Building Autonomous AgentsJuly 25, 2023 · ICLR 2024 (Poster)
- R-WoM: Retrieval-augmented World Model For Computer-use AgentsOctober 13, 2025 · ICLR 2026 (Poster)