ClickAgent: Enhancing UI Location Capabilities of Autonomous Agents

Proposes ClickAgent, a mobile agent framework that separates high-level reasoning from precise UI element localization. By pairing an MLLM planner with a dedicated grounding component, it improves task success on AITW and on real-device Android evaluations.

• You Only Look at Screens: Multimodal Chain-of-Action Agents
  September 20, 2023 · Findings of ACL 2024
• OpeFlo: Automated UX Evaluation via Simulated Human Web Interaction with GUI Grounding
  February 25, 2026 · arXiv
• MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research
  May 25, 2026 · arXiv
• ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agents
  April 13, 2026 · arXiv
• GraphPilot: GUI Task Automation with One-Step LLM Reasoning Powered by Knowledge Graph
  January 24, 2026 · Journal of Intelligent Computing and Networking
• GUITester: Enabling GUI Agents for Exploratory Defect Discovery
  January 8, 2026 · arXiv
• VenusBench-GD: A Comprehensive Multi-Platform GUI Benchmark for Diverse Grounding Tasks
  December 18, 2025 · arXiv
• AFRAgent : An Adaptive Feature Renormalization Based High Resolution Aware GUI agent
  November 30, 2025 · WACV 2026
• Surfer 2: The Next Generation of Cross-Platform Computer Use Agents
  October 22, 2025 · arXiv
• CORE: Reducing UI Exposure in Mobile Agents via Collaboration Between Cloud and Local LLMs
  October 17, 2025 · NeurIPS 2025 (Poster)
• Agent-SAMA: State-Aware Mobile Assistant
  May 29, 2025 · AAAI 2026
• BacktrackAgent: Enhancing GUI Agent with Error Detection and Backtracking Mechanism
  May 27, 2025 · EMNLP 2025 (Oral)
• GUI-explorer: Autonomous Exploration and Mining of Transition-aware Knowledge for GUI Agent
  May 22, 2025 · ACL 2025
• Building a Stable Planner: An Extended Finite State Machine Based Planning Module for Mobile GUI Agent
  May 20, 2025 · arXiv
• ScaleTrack: Scaling and back-tracking Automated GUI Agents
  May 1, 2025 · arXiv
• ReachAgent: Enhancing Mobile Agent via Page Reaching and Operation
  April 30, 2025 · NAACL 2025 (Poster)
• MobA: Multifaceted Memory-Enhanced Adaptive Planning for Efficient Mobile Task Automation
  April 30, 2025 · NAACL 2025 (System Demonstrations)
• LearnAct: Few-Shot Mobile GUI Agent with a Unified Demonstration Benchmark
  April 18, 2025 · arXiv
• UI-TARS: Pioneering Automated GUI Interaction with Native Agents
  January 21, 2025 · arXiv
• Ponder & Press: Advancing Visual GUI Agent towards General Computer Control
  December 2, 2024 · Findings of ACL 2025
• Improved GUI Grounding via Iterative Narrowing
  November 18, 2024 · arXiv
• OS-ATLAS: A Foundation Action Model for Generalist GUI Agents
  October 30, 2024 · ICLR 2025 (Spotlight)
• Lightweight Neural App Control
  October 23, 2024 · ICLR 2025 (Spotlight)
• DistRL: An Asynchronous Distributed Reinforcement Learning Framework for On-Device Control Agents
  October 18, 2024 · ICLR 2025 (Poster)