StepReflect: Structured UI Transition Reflection for Mobile GUI Agents

StepReflect recasts after-action reflection for mobile GUI agents as structured transition prediction over paired visual evidence. Its staged training recipe produces a local reflection model that improves several evaluated agent configurations while reducing dependence on repeated frontier-model calls.

• Reflection with Action-Induced Visual Differences for Desktop GUI Agents
  August 25, 2026 · arXiv
• LongHorizonUI: A Unified Framework for Robust long-horizon Task Automation of GUI Agent
  January 26, 2026 · ICLR 2026 (Poster)
• Unveiling Disparities in Web Task Handling Between Human and Web Agent
  May 7, 2024 · CHI 2024
• Online Dense Reinforcement Learning with Planning-Grounding Agent for UI Navigation on Live IOS Apps
  October 29, 2026 · arXiv
• GUI-JEPA: Candidate-Conditioned JEPA Latents as a Fast Action Policy for Mobile GUI Agents
  October 27, 2026 · arXiv
• iPrefBench: A User-Centric Benchmark for Personalized Mobile Use Agents
  October 26, 2026 · arXiv
• Chart the Invisible: Interactive Perception for Hidden-Target Exploration in GUI Agents
  October 26, 2026 · arXiv
• AndroidFlux: Evaluating Failure Recovery and Recovery Action Reward Modeling in Mobile-Use Multimodal Agents
  October 25, 2026 · arXiv
• Subgoal-aware Memory Graph for GUI Agent
  October 22, 2026 · arXiv
• Reuse, Rewrite, or Reject: Evidence-Constrained Trace Reuse for Repeated Mobile GUI Control
  October 22, 2026 · arXiv
• Diagnosing Personalization Failures in Mobile GUI Agents
  October 22, 2026 · arXiv
• Tandem: Serving Hybrid Linear-Attention GUI Agents on Mobile NPUs
  October 19, 2026 · arXiv
• ScopeMem: Latent Memory That Learns Where to Revise Frozen GUI Agents
  October 19, 2026 · arXiv
• Beyond Next-Screen Prediction: The Decision Value of GUI World Models
  October 17, 2026 · arXiv
• MobileJailBench: Red Queen Jailbreak Benchmarking for Mobile Agents
  October 16, 2026 · arXiv
• MobileInject: Evaluating Reasoning-to-Action Security of MLLM-Based Mobile Agents under Cross-Modal Consistency Injection
  October 16, 2026 · arXiv
• Not All Graphs Are Maps: A Task-Agnostic Exploration Framework for Mobile GUI Navigation
  October 15, 2026 · arXiv
• MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer Environments
  October 14, 2026 · arXiv
• How GUI Agents Fail: GraceBench for Execution Stability Diagnosis
  October 14, 2026 · arXiv
• Learning How to Remember: Memory Modality Selection for GUI Agents
  October 13, 2026 · arXiv
• Adaptive-Group Process Rewards for GUI Agents
  October 13, 2026 · arXiv
• Seg2Click: Learning Pixel-Level Action Masks for GUI Visual Grounding
  October 12, 2026 · arXiv
• PrivacyGuard: Source-Linked Sanitization and Locally Resolvable PII References for Cloud GUI Agents
  October 12, 2026 · arXiv
• OpenMobile-2: Building Versatile Mobile Agents with Scalable Environments and App-Native Tools
  October 9, 2026 · arXiv