From Interaction Traces to Persistent Skills: Online Evolution for Computer-Use Agents

This work converts computer-use-agent trajectories and evaluator feedback into a persistent, versioned library of reusable procedures through online skill evolution, running each iteration against a frozen library snapshot to isolate the library's incremental value.

• TeleTune: Evolving Agent Skills From Offline Telemetry
  October 4, 2026 · arXiv
• CONTRAMEM: Learning Self-Evolving Procedural Memory from Contrasting Multi-Model Trajectories
  August 23, 2026 · arXiv
• CUA-Skill: Develop Skills for Computer Using Agent
  January 28, 2026 · arXiv
• Back to Basics: A Skill-Centric Approach to Generalist Web Agents
  October 26, 2026 · arXiv
• Comparing Computer Use Behavior Across Multiple Levels of Abstraction
  October 19, 2026 · arXiv
• Agent World Model in the Wild: Computer-Use Agent Environment Synthesis
  October 19, 2026 · arXiv
• EconSkills: Studying Skill Transfer and Retrieval for Web Agents on Live Economic Data
  September 17, 2026 · arXiv
• FinCUABuild: Can Agents Build Reliable Benchmarks for Dynamic Financial Computer Use?
  September 7, 2026 · arXiv
• AgentHijack: Visual Patch Attacks on Multimodal Computer-Use Agents
  September 6, 2026 · arXiv
• SIR: Self-improving Red-teaming for Compute Use Agents
  August 31, 2026 · arXiv
• MAGNET: Towards Adaptive GUI Agents with Memory-Driven Knowledge Evolution
  January 27, 2026 · arXiv
• Where to Learn and How Far to Roll Out: Efficient Adaptive Training for GUI Agents
  October 29, 2026 · arXiv
• Right Click, Wrong Box: Grading GUI Grounding by What a Click Does
  October 27, 2026 · arXiv
• Learning to Look Beyond Screens: Transferable Visual Observation from GUI Grounding
  October 27, 2026 · arXiv
• From Interaction to Capability: Task Advancement as State and Supervision for GUI Agents
  October 27, 2026 · arXiv
• AdaGround: Token-Normalized Adaptive Zooming with Verifier-in-the-Loop Refinement for GUI Grounding
  October 27, 2026 · arXiv
• GUIFlow: Temporal Redundancy-Aware Incremental Inference for GUI Agents
  October 26, 2026 · arXiv
• PreView: Enhancing GUI Grounding with Preprocessed Views and Cues
  October 24, 2026 · arXiv
• OS-Wizard: Scaling Computer-Using Agents to Specialized Software via Knowledge-Guided Exploration
  October 24, 2026 · arXiv
• Build or Adopt? Custom-Built vs. General-Purpose LLM Agent Harnesses for Automotive GUI Testing
  October 24, 2026 · arXiv
• IGG: A Benchmark for Interactive GUI Grounding under Visibility Constraints
  October 23, 2026 · arXiv
• Correct Answers, Closed Gates: SolveBind for GUI Agents at the Verification Barrier
  October 23, 2026 · arXiv
• Trace2World: Reconstructing App Worlds from Real Interaction Traces for Scalable GUI Agent Training
  October 22, 2026 · arXiv
• PointerBench: A Diagnostic Benchmark for Fine-Grained GUI Grounding
  October 22, 2026 · arXiv