Comparing Computer Use Behavior Across Multiple Levels of Abstraction

Introduces Multi-level Action Parsing (MAP), a hierarchical semantic pipeline that maps human and computer-use agent interaction traces across linked levels of abstraction to diagnose behavioral gaps, navigation differences, and recovery behaviors.

• Agent World Model in the Wild: Computer-Use Agent Environment Synthesis
  October 19, 2026 · arXiv
• Trace2World: Reconstructing App Worlds from Real Interaction Traces for Scalable GUI Agent Training
  October 22, 2026 · arXiv
• VeriCUA: Learning Proactive Verification for Reliable GUI Agent Rewards
  October 19, 2026 · arXiv
• CUA-Lite: An Open Platform for Computer Use Agents
  October 19, 2026 · arXiv
• PersonaCUABench: Benchmarking Computer-Use Agents Serving Diverse Personas
  October 16, 2026 · arXiv
• Adaptation of Computer Use Agents to New Software with User Manuals
  October 16, 2026 · arXiv
• OpenGCUA: Toward a Fully Open Stack for Generalist Computer Use
  October 15, 2026 · arXiv
• OS-Helix: Unifying GUI Interaction and Code Execution in Native Computer-Using Agents
  October 15, 2026 · arXiv
• LEASH: Uncertainty-Aware Weak-to-Strong Escalation and Oversight for Computer-Use Agents
  October 15, 2026 · arXiv
• AgentHorizon: Evaluating Agentic Judges for Long-Horizon Computer-Use Tasks
  October 8, 2026 · arXiv
• FinCUABuild: Can Agents Build Reliable Benchmarks for Dynamic Financial Computer Use?
  September 7, 2026 · arXiv
• AgentHijack: Visual Patch Attacks on Multimodal Computer-Use Agents
  September 6, 2026 · arXiv
• From Interaction Traces to Persistent Skills: Online Evolution for Computer-Use Agents
  September 4, 2026 · arXiv
• SIR: Self-improving Red-teaming for Compute Use Agents
  August 31, 2026 · arXiv
• Next-Gen CAPTCHAs: Leveraging the Cognitive Gap for Scalable and Diverse GUI-Agent Defense
  February 9, 2026 · ICML 2026
• SusBench: An Online Benchmark for Evaluating Dark Pattern Susceptibility of Computer-Use Agents
  October 13, 2025 · IUI 2026
• Unveiling Disparities in Web Task Handling Between Human and Web Agent
  May 7, 2024 · CHI 2024
• Rico: A Mobile App Dataset for Building Data-Driven Design Applications
  October 20, 2017 · UIST 2017
• Where to Learn and How Far to Roll Out: Efficient Adaptive Training for GUI Agents
  October 29, 2026 · arXiv
• Right Click, Wrong Box: Grading GUI Grounding by What a Click Does
  October 27, 2026 · arXiv
• Learning to Look Beyond Screens: Transferable Visual Observation from GUI Grounding
  October 27, 2026 · arXiv
• From Interaction to Capability: Task Advancement as State and Supervision for GUI Agents
  October 27, 2026 · arXiv
• AdaGround: Token-Normalized Adaptive Zooming with Verifier-in-the-Loop Refinement for GUI Grounding
  October 27, 2026 · arXiv
• GUIFlow: Temporal Redundancy-Aware Incremental Inference for GUI Agents
  October 26, 2026 · arXiv