Towards Automated Crowdsourced Testing via Personified-LLM
Shengcheng Yu , Yuchen Ling , Chunrong Fang , Zhenyu Chen , Chunyang Chen
- 🏛 Institutions
- TUM , National Key Laboratory for Novel Software Technology , NJU
- 📅 Date
- March 25, 2026
- 📑 Publisher
- FSE 2026
- 💻 Env
- Mobile
- 🔑 Keywords
TLDR
PersonaTester automates crowdsourced GUI testing by injecting empirically derived tester personas into LLM agents. On 15 mobile apps, it reproduces more diverse testing behaviors than non-persona baselines and triggers more crashes and functional bugs.
Related papers (24)
- GraphDroid: Asynchronous LLM-Based Mobile App GUI Testing via History-Aware Exploration and Hybrid Intent FulfillmentSeptember 9, 2026 · arXiv
- GUITester: Enabling GUI Agents for Exploratory Defect DiscoveryJanuary 8, 2026 · arXiv
- GUIPilot: A Consistency-Based Mobile GUI Testing Approach for Detecting Application-Specific BugsJune 9, 2025 · ISSTA 2025
- AUITestAgent: Automatic Requirements Oriented GUI Function TestingJuly 12, 2024 · arXiv
- Seeing is Believing: Vision-driven Non-crash Functional Bug Detection for Mobile AppsJuly 3, 2024 · arXiv
- Build or Adopt? Custom-Built vs. General-Purpose LLM Agent Harnesses for Automotive GUI TestingOctober 24, 2026 · arXiv
- SpecOps: A Fully Automated AI Agent Testing Framework in Real-World GUI EnvironmentsMarch 10, 2026 · ICSE 2026
- Online Dense Reinforcement Learning with Planning-Grounding Agent for UI Navigation on Live IOS AppsOctober 29, 2026 · arXiv
- GUI-JEPA: Candidate-Conditioned JEPA Latents as a Fast Action Policy for Mobile GUI AgentsOctober 27, 2026 · arXiv
- iPrefBench: A User-Centric Benchmark for Personalized Mobile Use AgentsOctober 26, 2026 · arXiv
- Chart the Invisible: Interactive Perception for Hidden-Target Exploration in GUI AgentsOctober 26, 2026 · arXiv
- AndroidFlux: Evaluating Failure Recovery and Recovery Action Reward Modeling in Mobile-Use Multimodal AgentsOctober 25, 2026 · arXiv
- Subgoal-aware Memory Graph for GUI AgentOctober 22, 2026 · arXiv
- Reuse, Rewrite, or Reject: Evidence-Constrained Trace Reuse for Repeated Mobile GUI ControlOctober 22, 2026 · arXiv
- Diagnosing Personalization Failures in Mobile GUI AgentsOctober 22, 2026 · arXiv
- Tandem: Serving Hybrid Linear-Attention GUI Agents on Mobile NPUsOctober 19, 2026 · arXiv
- ScopeMem: Latent Memory That Learns Where to Revise Frozen GUI AgentsOctober 19, 2026 · arXiv
- Beyond Next-Screen Prediction: The Decision Value of GUI World ModelsOctober 17, 2026 · arXiv
- MobileJailBench: Red Queen Jailbreak Benchmarking for Mobile AgentsOctober 16, 2026 · arXiv
- MobileInject: Evaluating Reasoning-to-Action Security of MLLM-Based Mobile Agents under Cross-Modal Consistency InjectionOctober 16, 2026 · arXiv
- Not All Graphs Are Maps: A Task-Agnostic Exploration Framework for Mobile GUI NavigationOctober 15, 2026 · arXiv
- MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer EnvironmentsOctober 14, 2026 · arXiv
- How GUI Agents Fail: GraceBench for Execution Stability DiagnosisOctober 14, 2026 · arXiv
- Learning How to Remember: Memory Modality Selection for GUI AgentsOctober 13, 2026 · arXiv