Demo2Tutorial: From Human Experience to Multimodal Software Tutorials

Demo2Tutorial converts screen recordings and interaction logs into structured multimodal software tutorials with parsed actions, intents, and hierarchical task graphs. The paper evaluates tutorial generation quality and shows that the resulting representations improve downstream GUI-agent planning and generalization.

• Executable Agentic Memory for GUI Agent
  May 12, 2026 · arXiv
• TreeCUA: Efficiently Scaling GUI Automation with Tree-Structured Verifiable Evolution
  February 10, 2026 · arXiv
• SSL: Sweet Spot Learning for Differentiated Guidance in Agentic Optimization
  January 30, 2026 · arXiv
• MobileWorldBench: Towards Semantic World Modeling For Mobile Agents
  December 16, 2025 · arXiv
• WebATLAS: An LLM Agent with Experience-Driven Memory and Action Simulation
  October 26, 2025 · NeurIPS 2025 Workshop on Language Agents and World Models
• Building a Stable Planner: An Extended Finite State Machine Based Planning Module for Mobile GUI Agent
  May 20, 2025 · arXiv
• LLM-Powered GUI Agents in Phone Automation: Surveying Progress and Prospects
  April 28, 2025 · TMLR 2025
• WebRollback: Enhancing Web Agents with Explicit Rollback Mechanisms
  April 16, 2025 · EACL 2026 (Oral)
• LiteWebAgent: The Open-Source Suite for VLM-Based Web-Agent Applications
  March 4, 2025 · NAACL 2025 System Demonstrations
• WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Tasks
  July 7, 2024 · NeurIPS 2024 Datasets and Benchmarks Track (Poster)
• A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesis
  July 24, 2023 · ICLR 2024 (Oral)
• VRL-Bench: Benchmarking agents on computer control tasks under finite trial budgets
  September 11, 2026 · arXiv
• TRACE: Trajectory-robust Admission with Evidence Ordering for Efficient GUI Agents
  September 9, 2026 · arXiv
• FinCUABuild: Can Agents Build Reliable Benchmarks for Dynamic Financial Computer Use?
  September 7, 2026 · arXiv
• Selective Knowledge Control for Continual GUI Agent Learning over Application Streams
  September 6, 2026 · arXiv
• AgentHijack: Visual Patch Attacks on Multimodal Computer-Use Agents
  September 6, 2026 · arXiv
• From Interaction Traces to Persistent Skills: Online Evolution for Computer-Use Agents
  September 4, 2026 · arXiv
• Do GUI Agents Know When Not to Act? Enabling Conflict-Aware Termination for Multimodal GUI Agents
  September 3, 2026 · arXiv
• Efficient GUI Agents: A Systems Survey of Observation, Memory, Action, and Runtime Optimization
  September 2, 2026 · arXiv
• SIR: Self-improving Red-teaming for Compute Use Agents
  August 31, 2026 · arXiv
• Iron: Intent-Aligned and Retrospective Dual Learning Framework for Enhancing Generalist Virtual Agents
  August 28, 2026 · arXiv
• UI-Venus-2 Technical Report
  August 27, 2026 · arXiv
• Task-Adaptive Rubrics for GUI Reward Modeling
  August 25, 2026 · arXiv
• CausalCache: Conditional High-Fidelity Restoration for Long-Horizon GUI Agents
  August 23, 2026 · arXiv