ClickAgent: Enhancing UI Location Capabilities of Autonomous Agents

Proposes ClickAgent, a mobile agent framework that separates high-level reasoning from precise UI element localization. By pairing an MLLM planner with a dedicated grounding component, it improves task success on AITW and on real-device Android evaluations.

• You Only Look at Screens: Multimodal Chain-of-Action Agents
  September 20, 2023 · Findings of ACL 2024
• OpeFlo: Automated UX Evaluation via Simulated Human Web Interaction with GUI Grounding
  February 25, 2026 · arXiv
• Beyond Next-Screen Prediction: The Decision Value of GUI World Models
  October 17, 2026 · arXiv
• Not All Graphs Are Maps: A Task-Agnostic Exploration Framework for Mobile GUI Navigation
  October 15, 2026 · arXiv
• Seg2Click: Learning Pixel-Level Action Masks for GUI Visual Grounding
  October 12, 2026 · arXiv
• ConClick: Element-Wise Contrastive Learning Improves GUI Grounding
  October 9, 2026 · arXiv
• Imagine to Act: High-Fidelity Data Synthesis via Image Editing World Model for Scalable GUI Agent Training
  October 5, 2026 · arXiv
• Decoupling What from Where: How Should a Small GUI Grounding Model Receive the Action Type?
  October 5, 2026 · arXiv
• Recurrent Latent Visual Search for GUI Grounding
  October 4, 2026 · arXiv
• MintAct: A Unified Visual Agent for Digital Environments
  September 18, 2026 · arXiv
• Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI Agents
  September 15, 2026 · arXiv
• GraphDroid: Asynchronous LLM-Based Mobile App GUI Testing via History-Aware Exploration and Hybrid Intent Fulfillment
  September 9, 2026 · arXiv
• Improving Proficiency and Efficiency of Android GUI Agents via Self-Generating Tool Actions
  September 6, 2026 · arXiv
• Lexical Coupling in GUI Element Grounding: Sentence Embeddings Track Labels across Mobile and Web
  August 22, 2026 · arXiv
• AOHP: An Open-Source OS-Level Agent Harness for Personalized, Efficient and Secure Interaction
  June 22, 2026 · arXiv
• MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research
  May 25, 2026 · arXiv
• ScaleWoB: Guiding GUI Agents with Coding Agents via Large-Scale Environmental Synthesis
  May 24, 2026 · arXiv
• ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agents
  April 13, 2026 · arXiv
• GraphPilot: GUI Task Automation with One-Step LLM Reasoning Powered by Knowledge Graph
  January 24, 2026 · Journal of Intelligent Computing and Networking
• GUITester: Enabling GUI Agents for Exploratory Defect Discovery
  January 8, 2026 · arXiv
• VenusBench-GD: A Comprehensive Multi-Platform GUI Benchmark for Diverse Grounding Tasks
  December 18, 2025 · arXiv
• AFRAgent : An Adaptive Feature Renormalization Based High Resolution Aware GUI agent
  November 30, 2025 · WACV 2026
• Surfer 2: The Next Generation of Cross-Platform Computer Use Agents
  October 22, 2025 · arXiv
• CORE: Reducing UI Exposure in Mobile Agents via Collaboration Between Cloud and Local LLMs
  October 17, 2025 · NeurIPS 2025 (Poster)