GUIDE: Resolving Domain Bias in GUI Agents through Real-Time Web Video Retrieval and Plug-and-Play Annotation
Rui Xie , Zhi Gao , Chenrui Shi , Zirui Shang , Lu Chen , Qing Li
- 🏛 Institutions
- SJTU , State Key Laboratory of General Artificial Intelligence , BIGAI , Beijing Institute of Technology
- 📅 Date
- March 27, 2026
- 📑 Publisher
- arXiv
- 💻 Env
- Desktop
- 🔑 Keywords
TLDR
GUIDE is a training-free add-on for desktop GUI agents that retrieves relevant tutorial videos, turns them into planning and grounding annotations, and injects that expertise into existing agents without changing model parameters. On OSWorld, it improves multiple agent families while also reducing execution steps.
Related papers (24)
- Evolving Agent InterfacesOctober 20, 2026 · arXiv
- CUA-Lite: An Open Platform for Computer Use AgentsOctober 19, 2026 · arXiv
- Agent World Model in the Wild: Computer-Use Agent Environment SynthesisOctober 19, 2026 · arXiv
- OpenGCUA: Toward a Fully Open Stack for Generalist Computer UseOctober 15, 2026 · arXiv
- OS-Helix: Unifying GUI Interaction and Code Execution in Native Computer-Using AgentsOctober 15, 2026 · arXiv
- LEASH: Uncertainty-Aware Weak-to-Strong Escalation and Oversight for Computer-Use AgentsOctober 15, 2026 · arXiv
- MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer EnvironmentsOctober 14, 2026 · arXiv
- Pack Light, CarryOn: Building Object-Oriented Context for Long-Horizon AgentsOctober 13, 2026 · arXiv
- Learning How to Remember: Memory Modality Selection for GUI AgentsOctober 13, 2026 · arXiv
- Work2Skill: Capturing Human GUI Experience for Reusable Agent Skill InductionOctober 9, 2026 · arXiv
- Latent World Action Model for GUI AgentsOctober 9, 2026 · arXiv
- AgentHorizon: Evaluating Agentic Judges for Long-Horizon Computer-Use TasksOctober 8, 2026 · arXiv
- Control OSWorld: An AI Control Environment for GUI Computer Use AgentsOctober 2, 2026 · arXiv
- CUAWright: A Minimal Unified Interface for Digital AgentsOctober 2, 2026 · arXiv
- GUI-HARVEST: Self-Improving GUI Agents through Evidence-Driven Harness EvolutionOctober 1, 2026 · arXiv
- AutoGUIWorld: Image Generators as Visual World Models for GUI AgentOctober 1, 2026 · arXiv
- Talk2Agent: Benchmarking Voice Interfaces for Text AgentsSeptember 30, 2026 · arXiv
- OSWorld-Science: A Benchmark of Computer Use Agents for Learning and Using Scientific SoftwareSeptember 30, 2026 · arXiv
- ComputerSD: Online Self-Distillation from Real-Time Feedback for Computer-Use AgentsSeptember 30, 2026 · arXiv
- Neuro-Symbolic Computer Use: Learning Reusable Policies for Reliable and Efficient ExecutionSeptember 29, 2026 · arXiv
- HybridCUA: Learning to Orchestrate GUI and CLI for Computer-Use AgentsSeptember 29, 2026 · arXiv
- Absorbed in Inertia: Activation Analysis for Computer-Use AgentsSeptember 29, 2026 · arXiv
- OSWorld-Pro: Process-based Evaluation for Computer Use AgentsSeptember 21, 2026 · arXiv
- RSIAgent: Autonomous Exploration for Recursive Self-improvement in New EnvironmentsSeptember 14, 2026 · arXiv