AutoDroid: LLM-powered Task Automation in Android

Hao Wen , Yuanchun Li , Guohong Liu , Shanhui Zhao , Tao Yu , Toby Jia-Jun Li , Shiqi Jiang , Yunhao Liu , Yaqin Zhang , Yunxin Liu

🏛 Institutions: Tsinghua , Harbin Institute of Technology , University of Notre Dame , MSR Asia
📅 Date: August 29, 2023
📑 Publisher: MobiCom 2024
💻 Env: Mobile
🔑 Keywords: framework benchmark Android task automation dynamic analysis memory injection AutoDroid

TLDR

AutoDroid is an Android task-automation framework that combines LLM commonsense with app-specific knowledge collected through automated dynamic analysis. It introduces functionality-aware UI representations and exploration-based memory injection, and evaluates the system on a 158-task benchmark for memory-augmented Android automation.

Open paper Report issue