GraphPilot: GUI Task Automation with One-Step LLM Reasoning Powered by Knowledge Graph

Mingxian Yu, Siqi Luo, Xu Chen

🏛 Institutions: Sun Yat-sen University
📅 Date: January 24, 2026
📑 Publisher: Journal of Intelligent Computing and Networking
💻 Env: Mobile
🔑 Keywords: framework knowledge graph one-query planning validator GraphPilot

TLDR

GraphPilot builds app-specific knowledge graphs that encode page functions, element roles, and transition rules, then uses them to plan nearly complete action sequences in almost one LLM query. On DroidTask it improves task completion while sharply reducing latency and the number of LLM calls relative to stepwise mobile agents.

Open paper arXiv Edit on GitHub Report issue