Autonomous Evaluation and Refinement of Digital Agents

This paper studies domain-general automatic evaluators for web-navigation and device-control agents, showing 74.4% to 92.9% agreement with oracle evaluation metrics across popular digital-agent benchmarks. It then uses those evaluators for fine-tuning and inference-time guidance, improving WebArena performance by 29% and device-control settings by around 75% relative.

• GUI-HARVEST: Self-Improving GUI Agents through Evidence-Driven Harness Evolution
  October 1, 2026 · arXiv
• SCAFFOLD: Self-Improving Web Agents via Recursive Parametric Skill Abstraction
  August 31, 2026 · arXiv
• OpenWebVoyager: Building Multimodal Web Agents via Iterative Real-World Exploration, Feedback and Optimization
  October 25, 2024 · ACL 2025
• Agent-E: From Autonomous Web Navigation to Foundational Design Principles in Agentic Systems
  July 17, 2024 · arXiv
• Large Language Models Can Self-Improve At Web Agent Tasks
  May 30, 2024 · arXiv
• Towards Safe Autonomy for Computer Use
  October 13, 2026 · arXiv
• Pack Light, CarryOn: Building Object-Oriented Context for Long-Horizon Agents
  October 13, 2026 · arXiv
• Learning How to Remember: Memory Modality Selection for GUI Agents
  October 13, 2026 · arXiv
• Interaction-as-a-Judge
  October 13, 2026 · arXiv
• Adaptive-Group Process Rewards for GUI Agents
  October 13, 2026 · arXiv
• PrivacyGuard: Source-Linked Sanitization and Locally Resolvable PII References for Cloud GUI Agents
  October 12, 2026 · arXiv
• Learn from Move: the Next Step for GUI Agents
  October 12, 2026 · arXiv
• Work2Skill: Capturing Human GUI Experience for Reusable Agent Skill Induction
  October 9, 2026 · arXiv
• Latent World Action Model for GUI Agents
  October 9, 2026 · arXiv
• Right Screen, Wrong Transition: World Models as Verifiers for GUI Agents
  October 8, 2026 · arXiv
• AgentHorizon: Evaluating Agentic Judges for Long-Horizon Computer-Use Tasks
  October 8, 2026 · arXiv
• Secure-CUA: Controlling Untrusted Influence in Computer-Use Agents
  October 7, 2026 · arXiv
• PlaySuite: A Large-Scale Benchmark for Interactive Visual Intelligence
  October 5, 2026 · arXiv
• Imagine to Act: High-Fidelity Data Synthesis via Image Editing World Model for Scalable GUI Agent Training
  October 5, 2026 · arXiv
• TeleTune: Evolving Agent Skills From Offline Telemetry
  October 4, 2026 · arXiv
• CUAWright: A Minimal Unified Interface for Digital Agents
  October 2, 2026 · arXiv
• Not All Experience Belongs in the Weights: Component Routing for Self-Improving GUI Agents
  October 1, 2026 · arXiv
• CUA-Sandbox: Efficient Environments for Computer-Use Agent Reinforcement Learning
  September 26, 2026 · arXiv
• RecreationWorld: Scalable and Verifiable Environments for Hybrid Computer-Use Agents
  September 18, 2026 · arXiv