GUI Agents Papers
Star · 821

META-GUI: Towards Multi-modal Conversational Agents on Mobile GUI

Liangtai Sun , Xingyu Chen , Lu Chen , Tianle Dai , Zichen Zhu , Kai Yu

🏛 Institutions
SJTU
📅 Date
May 23, 2022
📑 Publisher
EMNLP 2022
💻 Env
Mobile
🔑 Keywords
TLDR

META-GUI introduces a GUI-based task-oriented dialogue architecture in which the assistant acts on real mobile apps instead of calling task-specific backend APIs. The paper also releases a dataset for training multimodal conversational agents under that GUI-TOD setup.

Open paper Report issue
Related papers (24)