Software Engineering for and with GUI Agent

This survey reviews 336 GUI-agent papers through a software-engineering lens, covering architectures, evaluation, lifecycle concerns, and deployment gaps. It identifies recurring weaknesses in recovery, safety enforcement, auditability, testing, and maintenance.

• Efficient GUI Agents: A Systems Survey of Observation, Memory, Action, and Runtime Optimization
  September 2, 2026 · arXiv
• FailureMem: A Failure-Aware Multimodal Framework for Autonomous Software Repair
  March 18, 2026 · arXiv
• Where Not to Learn: Prior-Aligned Training with Subset-based Attribution Constraints for Reliable Decision-Making
  January 30, 2026 · arXiv
• A Survey on the Safety and Security Threats of Computer-Using Agents: JARVIS or Ultron?
  May 16, 2025 · arXiv
• A Survey on GUI Agents with Foundation Models Enhanced by Reinforcement Learning
  April 29, 2025 · arXiv
• Towards Trustworthy GUI Agents: A Survey
  March 30, 2025 · arXiv
• OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use
  December 20, 2024 · ACL 2025
• GUI Agents: A Survey
  December 18, 2024 · Findings of ACL 2025
• GUI Agents with Foundation Models: A Comprehensive Survey
  November 7, 2024 · arXiv
• LLM-Powered GUI Agents in Phone Automation: Surveying Progress and Prospects
  April 28, 2025 · TMLR 2025
• A Survey of WebAgents: Towards Next-Generation AI Agents for Web Automation with Large Foundation Models
  March 30, 2025 · KDD 2025
• Programming with Pixels: Can Computer-Use Agents do Software Engineering?
  February 24, 2025 · ICLR 2026 (Poster)
• Generalist Virtual Agents: A Survey on Autonomous Agents Across Digital Platforms
  November 17, 2024 · arXiv
• VRL-Bench: Benchmarking agents on computer control tasks under finite trial budgets
  September 11, 2026 · arXiv
• TRACE: Trajectory-robust Admission with Evidence Ordering for Efficient GUI Agents
  September 9, 2026 · arXiv
• FinCUABuild: Can Agents Build Reliable Benchmarks for Dynamic Financial Computer Use?
  September 7, 2026 · arXiv
• Selective Knowledge Control for Continual GUI Agent Learning over Application Streams
  September 6, 2026 · arXiv
• AgentHijack: Visual Patch Attacks on Multimodal Computer-Use Agents
  September 6, 2026 · arXiv
• From Interaction Traces to Persistent Skills: Online Evolution for Computer-Use Agents
  September 4, 2026 · arXiv
• Do GUI Agents Know When Not to Act? Enabling Conflict-Aware Termination for Multimodal GUI Agents
  September 3, 2026 · arXiv
• SIR: Self-improving Red-teaming for Compute Use Agents
  August 31, 2026 · arXiv
• Iron: Intent-Aligned and Retrospective Dual Learning Framework for Enhancing Generalist Virtual Agents
  August 28, 2026 · arXiv
• UI-Venus-2 Technical Report
  August 27, 2026 · arXiv
• Task-Adaptive Rubrics for GUI Reward Modeling
  August 25, 2026 · arXiv