HATS: Hardness-Aware Trajectory Synthesis for GUI Agents
Rui Shao , Ruize Gao , Bin Xie , Yixing Li , Kaiwen Zhou , Shuai Wang , Weili Guan , Gongwei Chen
- 🏛 Institutions
- HIT-Shenzhen , NUS , CNRS@CREATE , Shenzhen Loop Area Institute , Huawei Noah's Ark Lab
- 📅 Date
- March 12, 2026
- 📑 Publisher
- CVPR 2026
- 💻 Env
- Web Mobile
- 🔑 Keywords
TLDR
HATS synthesizes GUI-agent training trajectories by modeling action hardness as semantic ambiguity and combining hardness-driven exploration with alignment-guided refinement, improving data quality and downstream performance on both WebArena and AndroidWorld.
Related papers (24)
- WebWorld: A Large-Scale World Model for Web Agent TrainingFebruary 16, 2026 · arXiv
- BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI AgentsSeptember 11, 2026 · arXiv
- Are Android GUI Agents Robust Against Runtime Anomalies? AnTrap: Evaluating Agents in Dynamic Adversarial EnvironmentsAugust 25, 2026 · arXiv
- Routing Is Least Learnable Where It Is Most Valuable: Bounds on Representation Routing for Web AgentsAugust 6, 2026 · arXiv
- SEE: Structure-aware Exploring and Exploiting for Long-horizon GUI Agent Trajectory SynthesisJuly 20, 2026 · arXiv
- Online Skill Learning for Web Agents via State-Grounded Dynamic RetrievalJune 3, 2026 · arXiv
- SE-GA: Memory-Augmented Self-Evolution for GUI AgentsMay 16, 2026 · ICML 2026
- The Tool Illusion: Rethinking Tool Use in Web AgentsApril 3, 2026 · arXiv
- When Users Change Their Mind: Evaluating Interruptible Agents in Long-Horizon Web NavigationApril 1, 2026 · arXiv
- WebArena-Infinity: Generating Browser Environments with Verifiable Tasks at ScaleMarch 2026 · Blog Post
- UI-Voyager: A Self-Evolving GUI Agent Learning via Failed ExperienceMarch 25, 2026 · arXiv
- AI Planning Framework for LLM-Based Web AgentsMarch 13, 2026 · arXiv
- OpAgent: Operator Agent for Web NavigationFebruary 14, 2026 · arXiv
- Adaptive Milestone Reward for GUI AgentsFebruary 12, 2026 · arXiv
- DynaWeb: Model-Based Reinforcement Learning of Web AgentsJanuary 29, 2026 · arXiv
- ColorBrowserAgent: Complex Long-Horizon Browser Agent with Adaptive Knowledge EvolutionJanuary 12, 2026 · arXiv
- WebOperator: Action-Aware Tree Search for Autonomous Agents in Web EnvironmentDecember 14, 2025 · arXiv
- STEP: Success-Rate-Aware Trajectory-Efficient Policy OptimizationNovember 17, 2025 · Findings of ACL 2026
- WALT: Web Agents that Learn ToolsOctober 1, 2025 · ICLR 2026 (Poster)
- MobileRL: Online Agentic Reinforcement Learning for Mobile GUI AgentsSeptember 10, 2025 · ICLR 2026 (Poster)
- Succeed or Learn Slowly: Sample Efficient Off-Policy Reinforcement Learning for Mobile App ControlSeptember 1, 2025 · NeurIPS 2025 (Poster)
- Explorer: Scaling Exploration-driven Web Trajectory Synthesis for Multimodal Web AgentsJuly 2025 · Findings of ACL 2025
- Go-Browse: Training Web Agents with Structured ExplorationJune 4, 2025 · ICLR 2026 (Poster)
- Inducing Programmatic Skills for Agentic TasksApril 9, 2025 · COLM 2025