Step-GUI Technical Report
Haolong Yan , Jia Wang , Xin Huang , Yeqing Shen , Ziyang Meng , Zhimin Fan , Kaijun Tan , Jin Gao , Lieyu Shi , Mi Yang , Shiliang Yang , Zhirui Wang , Brian Li , Kang An , Chenyang Li , Lei Lei , Mengmeng Duan , Danxun Liang , Guodong Liu , Hang Cheng , Hao Wu , Jie Dong , Junhao Huang , Mei Chen , Renjie Yu , Shunshan Li , Xu Zhou , Yiting Dai , Yineng Deng , Yingdan Liang , Zelin Chen , Wen Sun , Chengxu Yan , Chunqin Xu , Dong Li , Fengqiong Xiao , Guanghao Fan , Guopeng Li , Guozhen Peng , Hongbing Li , Hang Li , Hongming Chen , Jingjing Xie , Jianyong Li , Jingyang Zhang , Jiaju Ren , Jiayu Yuan , Jianpeng Yin , Kai Cao , Liang Zhao , Liguo Tan , Liying Shi , Mengqiang Ren , Min Xu , Manjiao Liu , Mao Luo , Mingxin Wan , Na Wang , Nan Wu , Ning Wang , Peiyao Ma , Qingzhou Zhang , Qiao Wang , Qinlin Zeng , Qiong Gao , Qiongyao Li , Shangwu Zhong , Shuli Gao , Shaofan Liu , Shisi Gao , Shuang Luo , Xingbin Liu , Xiaojia Liu , Xiaojie Hou , Xin Liu , Xuanti Feng , Xuedan Cai , Xuan Wen , Xianwei Zhu , Xin Liang , Xin Zhou , Yifan Sui , Yingxiu Zhao , Yukang Shi , Yunfang Xu , Yuqing Zeng , Yixun Zhang , Zejia Weng , Zhonghao Yan , Zhiguo Huang , Zhuoyu Wang , Zihan Yan , Zheng Ge , Jing Li , Yibo Zhu , Binxing Jiao , Xiangyu Zhang , Daxin Jiang
- 🏛 Institutions
- StepFun
- 📅 Date
- December 17, 2025
- 📑 Publisher
- arXiv
- 💻 Env
- Desktop Mobile
- 🔑 Keywords
Step-GUI centers on a self-evolving training pipeline built around the Calibrated Step Reward System, which calibrates model-generated GUI trajectories against trajectory-level signals to produce high-quality supervision at much lower annotation cost. On top of that pipeline, the paper introduces 4B and 8B GUI specialist models, the GUI-MCP protocol, and the AndroidDaily benchmark.
- MintAct: A Unified Visual Agent for Digital EnvironmentsSeptember 18, 2026 · arXiv
- LLaDA-UI: Bringing Block-wise Diffusion to Vision-Language GUI AgentsSeptember 9, 2026 · arXiv
- Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI AgentsJuly 30, 2026 · arXiv
- Mobile-Agent-v3.5: Multi-platform Fundamental GUI AgentsFebruary 15, 2026 · arXiv
- OmegaUse: Building a General-Purpose GUI Agent for Autonomous Task ExecutionJanuary 28, 2026 · arXiv
- MAI-UI Technical Report: Real-World Centric Foundation GUI AgentsDecember 26, 2025 · arXiv
- ScaleCUA: Scaling Open-Source Computer Use Agents with Cross-Platform DataSeptember 18, 2025 · ICLR 2026 (Oral)
- Mobile-Agent-v3: Fundamental Agents for GUI AutomationAugust 21, 2025 · arXiv
- UI-Venus Technical Report: Building High-performance UI Agents with RFTAugust 14, 2025 · arXiv
- SpiritSight Agent: Advanced GUI Agent with One LookMarch 5, 2025 · CVPR 2025 (Poster)
- UI-TARS: Pioneering Automated GUI Interaction with Native AgentsJanuary 21, 2025 · arXiv
- Ponder & Press: Advancing Visual GUI Agent towards General Computer ControlDecember 2, 2024 · Findings of ACL 2025
- OS-ATLAS: A Foundation Action Model for Generalist GUI AgentsOctober 30, 2024 · ICLR 2025 (Spotlight)
- OS-Helix: Unifying GUI Interaction and Code Execution in Native Computer-Using AgentsOctober 15, 2026 · arXiv
- DeskForge: Dense Supervision from Desktop Environments for Computer-Use AgentsOctober 1, 2026 · arXiv
- AutoGUIWorld: Image Generators as Visual World Models for GUI AgentOctober 1, 2026 · arXiv
- HybridCUA: Learning to Orchestrate GUI and CLI for Computer-Use AgentsSeptember 29, 2026 · arXiv
- Learn How to Act from Your Own Interactions: On-Policy Self-Distillation for GUI AgentsSeptember 23, 2026 · arXiv
- Towards Omni-dimensional GUI Agent Navigation with Masked Trajectory PredictionSeptember 22, 2026 · EMNLP 2026
- MATE: Policy-Aware Security Auditing for Mobile Agents via Synthesis-Driven Trajectory LearningSeptember 19, 2026 · USENIX Security 2026
- BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI AgentsSeptember 11, 2026 · arXiv
- Qwen-CUA: Native Computer Use for (almost) EverythingAugust 3, 2026 · arXiv
- Xiaomi-GUI-0 Technical ReportJune 30, 2026 · arXiv
- AndroidDaily: A Verifiable Benchmark for Mobile GUI Agents on Real-World Closed-Source ApplicationsMay 26, 2026 · arXiv