Action Conditioned Bisimulation For GUI Agent Memory
Hongbo Zhang , Liuyang Song , Quanquan Li , Daqian Yang , Yan Wen , Zhengtao Yao
- 🏛 Institutions
- PKU , East China Normal University , USC
- 📅 Date
- September 30, 2026
- 📑 Publisher
- arXiv
- 💻 Env
- Web
- 🔑 Keywords
TLDR
Defines when a web agent's memory should treat two pages as the same state using an action-conditioned bisimulation over the empirical state graph a frozen agent builds as it acts: two states merge only when their shared actions lead to agreeing outcomes. Nothing is trained, and replacing an outcome-value memory's merge rule with it raises success on MiniWoB++.
Related papers (24)
- In-Context Teacher–Student Guidance for Open-Weight Browser AgentsSeptember 2026 · KDMiLe 2026
- WebATLAS: An LLM Agent with Experience-Driven Memory and Action SimulationOctober 26, 2025 · NeurIPS 2025 Workshop on Language Agents and World Models
- Relevance Does Not Imply Applicability: Experience Activation for Personal GUI AgentsSeptember 27, 2026 · arXiv
- MHVF: Training-Free GUI Grounding via Verification-Guided Multi-Hypothesis SearchOctober 13, 2026 · arXiv
- Auditing Web Agent Evaluation on WebArena-Lite: Human Review of Outcomes and TrajectoriesOctober 1, 2026 · NeurIPS 2026 Workshop on Who Verifies the Agents? Toward Reliable Agent Development
- Probe to Act: Elevating Browser-Use Agent via Active Visual ProbingSeptember 27, 2026 · Findings of EMNLP 2026
- Hybrid Self-evolving Structured Memory for Computer-Use AgentsMarch 11, 2026 · Findings of ACL 2026
- Enhancing Web Agents with a Hierarchical Memory TreeMarch 7, 2026 · arXiv
- M^2: Dual-Memory Augmentation for Long-Horizon Web Agents via Trajectory Summarization and Insight RetrievalFebruary 28, 2026 · arXiv
- Mobile-Agent-v3.5: Multi-platform Fundamental GUI AgentsFebruary 15, 2026 · arXiv
- Improved GUI Grounding via Iterative NarrowingNovember 18, 2024 · arXiv
- Auto-Intent: Automated Intent Discovery and Self-Exploration for Large Language Model Web AgentsOctober 29, 2024 · Findings of EMNLP 2024
- Navigating WebAI: Training Agents to Complete Web Tasks with Large Language Models and Reinforcement LearningMay 1, 2024 · SAC 2024
- Reinforcement Learning on Web Interfaces Using Workflow-Guided ExplorationFebruary 24, 2018 · ICLR 2018 (Poster)
- World of Bits: An Open-Domain Platform for Web-Based AgentsAugust 31, 2017 · ICML 2017
- From Interaction to Capability: Task Advancement as State and Supervision for GUI AgentsOctober 27, 2026 · arXiv
- ScopeMem: Latent Memory That Learns Where to Revise Frozen GUI AgentsOctober 19, 2026 · arXiv
- Not All Experience Belongs in the Weights: Component Routing for Self-Improving GUI AgentsOctober 1, 2026 · arXiv
- PrecogUI: Proactive GUI Agents via Pre-cognitive Simulation and Experience RetrievalSeptember 29, 2026 · arXiv
- Absorbed in Inertia: Activation Analysis for Computer-Use AgentsSeptember 29, 2026 · arXiv
- PhoneCLI: From App Interfaces to Callable Commands for Mobile AgentsSeptember 28, 2026 · arXiv
- EchoPath: Execution-Level Replayable Memory for GUI AgentsSeptember 15, 2026 · arXiv
- AnchorGUI: Asymmetric Memory for Dual-Scale Learning in GUI NavigationSeptember 14, 2026 · ECCV 2026
- Efficient GUI Agents: A Systems Survey of Observation, Memory, Action, and Runtime OptimizationSeptember 2, 2026 · arXiv