Android in the Wild: A Large-Scale Dataset for Android Device Control
Christopher Rawles , Alice Li , Daniel Rodriguez , Oriana Riva , Timothy Lillicrap
- 🏛 Institutions
- Google Research , Google DeepMind
- 📅 Date
- July 19, 2023
- 📑 Publisher
- NeurIPS 2023 Datasets and Benchmarks Track
- 💻 Env
- Mobile
- 🔑 Keywords
TLDR
Introduces Android in the Wild, a large-scale dataset of human-labeled Android device-control episodes with natural-language commands and touch actions. It became one of the central training and evaluation resources for mobile agents because it stresses robustness across apps, tasks, and gesture types.
Related papers (24)
- PSPA-Bench: A Personalized Benchmark for Smartphone GUI AgentMarch 31, 2026 · arXiv
- SecAgent: Efficient Mobile GUI Agent with Semantic ContextMarch 9, 2026 · arXiv
- Turing Test on Screen: A Benchmark for Mobile GUI Agent HumanizationFebruary 24, 2026 · arXiv
- AmbiBench: Benchmarking Mobile GUI Agents Beyond One-Shot Instructions in the WildFebruary 12, 2026 · arXiv
- MemGUI-Bench: Benchmarking Memory of Mobile GUI Agents in Dynamic EnvironmentsFebruary 3, 2026 · arXiv
- SwipeGen: Bridging the Execution Gap in GUI Agents via Human-like Swipe SynthesisJanuary 26, 2026 · arXiv
- SMAN-Bench: A Cross-System Benchmark for Mobile Agents under Single- and Multi-path, Ambiguous, and Noisy TasksJanuary 26, 2026 · ICLR 2026 (Poster)
- MobileWorldBench: Towards Semantic World Modeling For Mobile AgentsDecember 16, 2025 · arXiv
- NaturalGAIA: Pushing the Frontiers of GUI Agents with a Challenging Benchmark and High-Quality Trajectory DatasetAugust 2, 2025 · arXiv
- FingerTip 20K: A Benchmark for Proactive and Personalized Mobile LLM AgentsJune 9, 2025 · ICLR 2026 (Poster)
- LearnAct: Few-Shot Mobile GUI Agent with a Unified Demonstration BenchmarkApril 18, 2025 · arXiv
- AndroidLab: Training and Systematic Benchmarking of Android Autonomous AgentsOctober 31, 2024 · ACL 2025
- GUI-World: A Video Benchmark and Dataset for Multimodal GUI-oriented UnderstandingJune 16, 2024 · ICLR 2025 (Poster)
- LlamaTouch: A Faithful and Scalable Testbed for Mobile UI Task AutomationApril 12, 2024 · UIST 2024
- Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMsApril 8, 2024 · ECCV 2024 (Poster)
- SeeClick: Harnessing GUI Grounding for Advanced Visual GUI AgentsJanuary 17, 2024 · ACL 2024
- CogAgent: A Visual Language Model for GUI AgentsDecember 14, 2023 · CVPR 2024 (Highlight)
- GPT-4V in Wonderland: Large Multimodal Models for Zero-Shot Smartphone GUI NavigationNovember 13, 2023 · arXiv
- You Only Look at Screens: Multimodal Chain-of-Action AgentsSeptember 20, 2023 · Findings of ACL 2024
- A Dataset for Interactive Vision-Language Navigation with Unknown Command FeasibilityFebruary 4, 2022 · ECCV 2022
- Screen2Words: Automatic Mobile UI Summarization with Multimodal LearningAugust 6, 2021 · UIST 2021
- Widget Captioning: Generating Natural Language Description for Mobile User Interface ElementsNovember 30, 2020 · EMNLP 2020
- Mapping Natural Language Instructions to Mobile UI Action SequencesJuly 31, 2020 · ACL 2020
- WebForge: Breaking the Realism-Reproducibility-Scalability Trilemma in Browser Agent BenchmarkApril 13, 2026 · arXiv