CoCo-Agent: A Comprehensive Cognitive MLLM Agent for Smartphone GUI Automation

CoCo-Agent is a smartphone GUI agent built around comprehensive environment perception (CEP) and conditional action prediction (CAP). The paper reports state-of-the-art performance on AITW and META-GUI, arguing that richer multimodal environment modeling improves mobile action selection.

• ClickAgent: Enhancing UI Location Capabilities of Autonomous Agents
  October 9, 2024 · SIGDIAL 2025
• DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning
  June 14, 2024 · NeurIPS 2024 Main Conference Track
• CogAgent: A Visual Language Model for GUI Agents
  December 14, 2023 · CVPR 2024 (Highlight)
• You Only Look at Screens: Multimodal Chain-of-Action Agents
  September 20, 2023 · Findings of ACL 2024
• Android in the Wild: A Large-Scale Dataset for Android Device Control
  July 19, 2023 · NeurIPS 2023 Datasets and Benchmarks Track
• META-GUI: Towards Multi-modal Conversational Agents on Mobile GUI
  May 23, 2022 · EMNLP 2022
• BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agents
  September 11, 2026 · arXiv
• JarvisGUI: Towards Cross-Device GUI Agents with Dynamic Task Composition
  September 9, 2026 · arXiv
• APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agents
  September 7, 2026 · arXiv
• Improving Proficiency and Efficiency of Android GUI Agents via Self-Generating Tool Actions
  September 6, 2026 · arXiv
• ElderBench: Benchmarking Autonomous Mobile Agents for Older Adults
  September 4, 2026 · arXiv
• WiP: Characterizing and Defending Against Mobile-Agent-Driven MFA Automation
  September 2, 2026 · arXiv
• GUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent Environments
  August 30, 2026 · arXiv
• ActReal: System-Level Mobile Agents Challenge Mobile Automation Detection
  August 30, 2026 · arXiv
• WM-R1: Training GUI Agents to Reason and leverage World Models with Reinforcement Learning
  August 27, 2026 · arXiv
• Are Android GUI Agents Robust Against Runtime Anomalies? AnTrap: Evaluating Agents in Dynamic Adversarial Environments
  August 25, 2026 · arXiv
• ADeptS-Bench: Measuring the Trustworthiness of Computer Use Agents Across Devices
  August 25, 2026 · arXiv
• GSAR: Goal-State-Anchor Rewards for Mobile GUI Agents with Self-Evolving Data Synthesis
  August 24, 2026 · arXiv
• Lexical Coupling in GUI Element Grounding: Sentence Embeddings Track Labels across Mobile and Web
  August 22, 2026 · arXiv
• Benchmarking General Mobile Assistants in Challenging Real-World Scenarios
  August 21, 2026 · arXiv
• Automated Trajectory Evaluation for Mobile Agents via Step-Level Consequence Reasoning and Aggregation
  August 21, 2026 · arXiv
• MobileWorldSafety: Benchmarking GUI Agent Safety Against Environmental Injection Attacks in Android Apps
  August 18, 2026 · arXiv
• CoAdapt-GUI: Joint Workflow Context and Policy Adaptation for Unseen GUI Applications
  August 12, 2026 · arXiv
• The Next Screenshot Knows: Gated Hindsight Distillation for Mobile GUI Agents
  August 6, 2026 · arXiv