Exploring Mobile UI Layout Generation using Large Language Models Guided by UI Grammar
Yuwen Lu, Ziang Tong, Qinyi Zhao, Chengzhi Zhang, Toby Jia-Jun Li
- 🏛 Institutions
- University of Notre Dame, Fudan University, Carnegie Mellon University
- 📅 Date
- October 24, 2023
- 📑 Publisher
- AI & HCI @ ICML 2023
- 💻 Env
- 🔑 Keywords
TLDR
This position paper studies mobile UI layout generation with LLMs and proposes a UI grammar to represent hierarchical screen structure. Its focus is controllable UI generation rather than GUI action or environment interaction, so it stays outside the direct-GUI agent main list.