HATS: Hardness-Aware Trajectory Synthesis for GUI Agents
Rui Shao , Ruize Gao , Bin Xie , Yixing Li , Kaiwen Zhou , Shuai Wang , Weili Guan , Gongwei Chen
- 🏛 Institutions
- HIT-Shenzhen , NUS , CNRS@CREATE , Shenzhen Loop Area Institute , Huawei Noah's Ark Lab
- 📅 Date
- March 12, 2026
- 📑 Publisher
- CVPR 2026
- 💻 Env
- Web Mobile
- 🔑 Keywords
TLDR
HATS synthesizes GUI-agent training trajectories by modeling action hardness as semantic ambiguity and combining hardness-driven exploration with alignment-guided refinement, improving data quality and downstream performance on both WebArena and AndroidWorld.
Related papers (24)
- WebWorld: A Large-Scale World Model for Web Agent TrainingFebruary 16, 2026 · arXiv
- Right Screen, Wrong Transition: World Models as Verifiers for GUI AgentsOctober 8, 2026 · arXiv
- One Rollout Is All You Get: Fully Test-Time Adaptation for GUI AgentsSeptember 28, 2026 · arXiv
- Back to Basics: A Skill-Centric Approach to Generalist Web AgentsOctober 26, 2026 · arXiv
- AndroidFlux: Evaluating Failure Recovery and Recovery Action Reward Modeling in Mobile-Use Multimodal AgentsOctober 25, 2026 · arXiv
- ScopeMem: Latent Memory That Learns Where to Revise Frozen GUI AgentsOctober 19, 2026 · arXiv
- Beyond Next-Screen Prediction: The Decision Value of GUI World ModelsOctober 17, 2026 · arXiv
- Why Generate a Click? Plug-in Decision Heads for Web AgentsOctober 14, 2026 · arXiv
- Teaching Agents in their Own Style: Blackbox Teacher Distillation for Web AgentsOctober 14, 2026 · arXiv
- STP-GUI: Spatially-Aware Token Pruning for Efficient Web-GUI AgentsOctober 14, 2026 · arXiv
- DeltaReplay: Task-Relative Memory Reuse for Mobile GUI AgentsOctober 8, 2026 · arXiv
- CLIFT: Conformal Self-Verification for Web Agent Training and Test-Time ScalingOctober 5, 2026 · arXiv
- AMBER: Training Long-Horizon Web Agents through Append-Only MemoryOctober 5, 2026 · arXiv
- PhoneCLI: From App Interfaces to Callable Commands for Mobile AgentsSeptember 28, 2026 · arXiv
- PastForward: Faster On-Device GUI Agents via Computational Experience ReuseSeptember 26, 2026 · arXiv
- Guides That Cause Actions: An Offline Study of Guide-Action Mutual Reinforcement in Multimodal Web AgentsSeptember 23, 2026 · arXiv
- AnchorGUI: Asymmetric Memory for Dual-Scale Learning in GUI NavigationSeptember 14, 2026 · ECCV 2026
- BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI AgentsSeptember 11, 2026 · arXiv
- AutoTailor: Automatic, User-Aligned Capability Selection and Adaptation for Web AgentsSeptember 11, 2026 · arXiv
- Are Android GUI Agents Robust Against Runtime Anomalies? AnTrap: Evaluating Agents in Dynamic Adversarial EnvironmentsAugust 25, 2026 · arXiv
- Routing Is Least Learnable Where It Is Most Valuable: Bounds on Representation Routing for Web AgentsAugust 6, 2026 · arXiv
- SEE: Structure-aware Exploring and Exploiting for Long-horizon GUI Agent Trajectory SynthesisJuly 20, 2026 · arXiv
- Online Skill Learning for Web Agents via State-Grounded Dynamic RetrievalJune 3, 2026 · arXiv
- SE-GA: Memory-Augmented Self-Evolution for GUI AgentsMay 16, 2026 · ICML 2026