Relevance Does Not Imply Applicability: Experience Activation for Personal GUI Agents
Fuyao Zhang , Xuan Wang , Zherui Li , Jiaming Zhang , Longtao Huang , Wei Yang Bryan Lim
- 🏛 Institutions
- NTU , Alibaba Group
- 📅 Date
- September 27, 2026
- 📑 Publisher
- arXiv
- 💻 Env
- General GUI
- 🔑 Keywords
TLDR
Argues that relevance does not imply applicability for personal GUI agents: retrieved history mainly helps the first step of an episode. ExpActivator is a training-free framework that matches each screen to historical states in the backbone's latent space and activates a recurring intent only when time and scenario support it, improving within-trajectory step success on four backbones.
Related papers (24)
- Action Conditioned Bisimulation For GUI Agent MemorySeptember 30, 2026 · arXiv
- WebATLAS: An LLM Agent with Experience-Driven Memory and Action SimulationOctober 26, 2025 · NeurIPS 2025 Workshop on Language Agents and World Models
- From Interaction to Capability: Task Advancement as State and Supervision for GUI AgentsOctober 27, 2026 · arXiv
- ScopeMem: Latent Memory That Learns Where to Revise Frozen GUI AgentsOctober 19, 2026 · arXiv
- Not All Experience Belongs in the Weights: Component Routing for Self-Improving GUI AgentsOctober 1, 2026 · arXiv
- PrecogUI: Proactive GUI Agents via Pre-cognitive Simulation and Experience RetrievalSeptember 29, 2026 · arXiv
- Efficient GUI Agents: A Systems Survey of Observation, Memory, Action, and Runtime OptimizationSeptember 2, 2026 · arXiv
- CausalCache: Conditional High-Fidelity Restoration for Long-Horizon GUI AgentsAugust 23, 2026 · arXiv
- STaR-KV: Spatio-Temporal Adaptive Re-weighting for KV Cache Compression in GUI Vision-Language ModelsJune 1, 2026 · arXiv
- Executable Agentic Memory for GUI AgentMay 12, 2026 · arXiv
- UI-Zoomer: Uncertainty-Driven Adaptive Zoom-In for GUI GroundingApril 15, 2026 · arXiv
- MAESTRO: Adapting GUIs and Guiding Navigation with User Preferences in Conversational Agents with GUIsApril 7, 2026 · arXiv
- Zoom to Essence: Trainless GUI Grounding by Inferring upon Interface ElementsMarch 15, 2026 · arXiv
- Trifuse: Enhancing Attention-Based GUI Grounding via Multimodal FusionFebruary 6, 2026 · arXiv
- Darwinian Memory: A Training-Free Self-Regulating Memory System for GUI Agent EvolutionJanuary 30, 2026 · arXiv
- MVP: Multiple View Prediction Improves GUI GroundingDecember 9, 2025 · arXiv
- Zoom in, Click out: Unlocking and Evaluating the Potential of Zooming for GUI GroundingDecember 5, 2025 · arXiv
- GUI-KV: Efficient GUI Agents via KV Cache with Spatio-Temporal AwarenessOctober 1, 2025 · arXiv
- MHVF: Training-Free GUI Grounding via Verification-Guided Multi-Hypothesis SearchOctober 13, 2026 · arXiv
- Can Agents Work for Everyone? Cross-User Reliability for Mobile GUI Agents in Personalized User InterfacesOctober 6, 2026 · arXiv
- Auditing Web Agent Evaluation on WebArena-Lite: Human Review of Outcomes and TrajectoriesOctober 1, 2026 · NeurIPS 2026 Workshop on Who Verifies the Agents? Toward Reliable Agent Development
- In-Context Teacher–Student Guidance for Open-Weight Browser AgentsSeptember 2026 · KDMiLe 2026
- AdaptArena: Evaluating Test-Time Personalization of Web AgentsSeptember 29, 2026 · arXiv
- Absorbed in Inertia: Activation Analysis for Computer-Use AgentsSeptember 29, 2026 · arXiv