One Rollout Is All You Get: Fully Test-Time Adaptation for GUI Agents
Ziqiang Wang , Li Gu , Zhixiang Chi , Linlian Jiang , Zihuan Jiang , Linqiang Guo , Siobhan Reid , Zhi Liu , Yang Wang
- 🏛 Institutions
- Concordia University , Mila , University of Toronto , Shanghai University
- 📅 Date
- September 28, 2026
- 📑 Publisher
- arXiv
- 💻 Env
- Web Mobile
- 🔑 Keywords
TLDR
Defines fully test-time adaptation for GUI agents, where a deployed agent gets one attempt per task and no ground truth, and proposes SOLO. A judge selects episodes it deems successful, a proposer-verifier pair relabels failed prefixes, and a small adapter is updated by top-K self-distillation, improving UI-TARS-7B and Qwen3-VL-8B by three to six points on recurring web and mobile task streams.
Related papers (24)
- Routing Is Least Learnable Where It Is Most Valuable: Bounds on Representation Routing for Web AgentsAugust 6, 2026 · arXiv
- WALT: Web Agents that Learn ToolsOctober 1, 2025 · ICLR 2026 (Poster)
- Right Screen, Wrong Transition: World Models as Verifiers for GUI AgentsOctober 8, 2026 · arXiv
- HATS: Hardness-Aware Trajectory Synthesis for GUI AgentsMarch 12, 2026 · CVPR 2026
- Back to Basics: A Skill-Centric Approach to Generalist Web AgentsOctober 26, 2026 · arXiv
- Why Generate a Click? Plug-in Decision Heads for Web AgentsOctober 14, 2026 · arXiv
- Teaching Agents in their Own Style: Blackbox Teacher Distillation for Web AgentsOctober 14, 2026 · arXiv
- STP-GUI: Spatially-Aware Token Pruning for Efficient Web-GUI AgentsOctober 14, 2026 · arXiv
- CLIFT: Conformal Self-Verification for Web Agent Training and Test-Time ScalingOctober 5, 2026 · arXiv
- AMBER: Training Long-Horizon Web Agents through Append-Only MemoryOctober 5, 2026 · arXiv
- Probe to Act: Elevating Browser-Use Agent via Active Visual ProbingSeptember 27, 2026 · Findings of EMNLP 2026
- Learn How to Act from Your Own Interactions: On-Policy Self-Distillation for GUI AgentsSeptember 23, 2026 · arXiv
- Guides That Cause Actions: An Offline Study of Guide-Action Mutual Reinforcement in Multimodal Web AgentsSeptember 23, 2026 · arXiv
- AutoTailor: Automatic, User-Aligned Capability Selection and Adaptation for Web AgentsSeptember 11, 2026 · arXiv
- Learning Simple Test-Time Environments for LLM Web AgentsAugust 29, 2026 · arXiv
- CoAdapt-GUI: Joint Workflow Context and Policy Adaptation for Unseen GUI ApplicationsAugust 12, 2026 · arXiv
- Online Skill Learning for Web Agents via State-Grounded Dynamic RetrievalJune 3, 2026 · arXiv
- The Tool Illusion: Rethinking Tool Use in Web AgentsApril 3, 2026 · arXiv
- When Users Change Their Mind: Evaluating Interruptible Agents in Long-Horizon Web NavigationApril 1, 2026 · arXiv
- WebArena-Infinity: Generating Browser Environments with Verifiable Tasks at ScaleMarch 2026 · Blog Post
- AI Planning Framework for LLM-Based Web AgentsMarch 13, 2026 · arXiv
- Generalization in Online Reinforcement Learning for Mobile AgentsMarch 8, 2026 · arXiv
- WebWorld: A Large-Scale World Model for Web Agent TrainingFebruary 16, 2026 · arXiv
- OpAgent: Operator Agent for Web NavigationFebruary 14, 2026 · arXiv