CogAgent: A Visual Language Model for GUI Agents

CogAgent is an 18B visual language model specialized for GUI understanding and navigation. It combines low- and high-resolution image encoders, trains on a large GUI-and-OCR dataset, and outperforms HTML-consuming baselines on Mind2Web and AITW using screenshots alone.

• SpiritSight Agent: Advanced GUI Agent with One Look
  March 5, 2025 · CVPR 2025 (Poster)
• ShowUI: One Vision-Language-Action Model for GUI Visual Agent
  November 26, 2024 · CVPR 2025 (Poster)
• OS-ATLAS: A Foundation Action Model for Generalist GUI Agents
  October 30, 2024 · ICLR 2025 (Spotlight)
• CaptchaArena: A Large-Scale, Fine-Grained Dataset for Training Computer-Use Agents on Interactive CAPTCHAs
  September 25, 2026 · arXiv
• MolmoWeb: Open Visual Web Agent and Open Data for the Open Web
  April 9, 2026 · arXiv
• SecAgent: Efficient Mobile GUI Agent with Semantic Context
  March 9, 2026 · arXiv
• OpenCUA: Open Foundations for Computer-Use Agents
  August 12, 2025 · NeurIPS 2025 (Spotlight)
• UI-Genie: A Self-Improving Approach for Iteratively Boosting MLLM-based Mobile GUI Agents
  May 27, 2025 · NeurIPS 2025 (Poster)
• Web-Shepherd: Advancing PRMs for Reinforcing Web Agents
  May 21, 2025 · NeurIPS 2025 (Spotlight)
• MobileVLM: A Vision-Language Model for Better Intra- and Inter-UI Understanding
  September 23, 2024 · Findings of EMNLP 2024
• Android in the Wild: A Large-Scale Dataset for Android Device Control
  July 19, 2023 · NeurIPS 2023 Datasets and Benchmarks Track
• Mind2Web: Towards a Generalist Agent for the Web
  June 9, 2023 · NeurIPS 2023 Datasets and Benchmarks Track
• Multimodal Web Navigation with Instruction-Finetuned Foundation Models
  May 19, 2023 · ICLR 2024
• Spotlight: Mobile UI Understanding using Vision-Language Models with a Focus
  September 29, 2022 · ICLR 2023 (Poster)
• Learning How to Remember: Memory Modality Selection for GUI Agents
  October 13, 2026 · arXiv
• DeskForge: Dense Supervision from Desktop Environments for Computer-Use Agents
  October 1, 2026 · arXiv
• HybridCUA: Learning to Orchestrate GUI and CLI for Computer-Use Agents
  September 29, 2026 · arXiv
• GUITAR: Structured Failure Diagnosis of GUI Agents via State Transitions
  September 28, 2026 · arXiv
• Towards Omni-dimensional GUI Agent Navigation with Masked Trajectory Prediction
  September 22, 2026 · EMNLP 2026
• RecreationWorld: Scalable and Verifiable Environments for Hybrid Computer-Use Agents
  September 18, 2026 · arXiv
• MintAct: A Unified Visual Agent for Digital Environments
  September 18, 2026 · arXiv
• LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI Agents
  September 9, 2026 · arXiv
• Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI Agents
  July 30, 2026 · arXiv
• Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agents
  February 15, 2026 · arXiv