StateAct: Program State, before Pixels, for Long-Horizon Computer-Use Agents
Yan Yang , Xiangru Jian , Ziyang Luo , Zirui Zhao , Yutong Dai , Ziji Shi , Hanshu Yan , Jun Hao Liew , Silvio Savarese , Junnan Li
- 🏛 Institutions
- Unknown
- 📅 Date
- July 24, 2026
- 📑 Publisher
- arXiv
- 💻 Env
- Desktop
- 🔑 Keywords
TLDR
StateAct is a code-first computer-use harness that lets a main agent directly inspect and edit program state, reserving GUI interaction for subgoals that require it. An independent finish gate validates results, and fresh subagents keep long-horizon context focused.
Related papers (24)
- VeriCUA: Learning Proactive Verification for Reliable GUI Agent RewardsOctober 19, 2026 · arXiv
- Task-State Governance: A Virtual Machine for Verifiable and Recoverable GUI Agent ExecutionOctober 14, 2026 · arXiv
- SCOUT: Synergizing Reasoning and Tool-Use for Computer-Use SafetySeptember 28, 2026 · arXiv
- StructAgent: Harness Long-horizon Digital Agents with Unified Causal StructureJuly 13, 2026 · arXiv
- ANCHOR: Branch-Point Data Generation for GUI AgentsFebruary 6, 2026 · arXiv
- MHVF: Training-Free GUI Grounding via Verification-Guided Multi-Hypothesis SearchOctober 13, 2026 · arXiv
- The Art of Building Verifiers for Computer Use AgentsApril 5, 2026 · arXiv
- ContractSkill: Repairable Contract-Based Skills for Multimodal Web AgentsMarch 20, 2026 · arXiv
- Agentic Reward Modeling: Verifying GUI Agent via Online Proactive InteractionJanuary 31, 2026 · arXiv
- OS-Wizard: Scaling Computer-Using Agents to Specialized Software via Knowledge-Guided ExplorationOctober 24, 2026 · arXiv
- Evolving Agent InterfacesOctober 20, 2026 · arXiv
- CUA-Recovery: Benchmarking Error Recovery in Long-Horizon Computer-Use AgentsOctober 20, 2026 · arXiv
- Comparing Computer Use Behavior Across Multiple Levels of AbstractionOctober 19, 2026 · arXiv
- CUA-Lite: An Open Platform for Computer Use AgentsOctober 19, 2026 · arXiv
- Agent World Model in the Wild: Computer-Use Agent Environment SynthesisOctober 19, 2026 · arXiv
- PersonaCUABench: Benchmarking Computer-Use Agents Serving Diverse PersonasOctober 16, 2026 · arXiv
- Adaptation of Computer Use Agents to New Software with User ManualsOctober 16, 2026 · arXiv
- OpenGCUA: Toward a Fully Open Stack for Generalist Computer UseOctober 15, 2026 · arXiv
- OS-Helix: Unifying GUI Interaction and Code Execution in Native Computer-Using AgentsOctober 15, 2026 · arXiv
- LEASH: Uncertainty-Aware Weak-to-Strong Escalation and Oversight for Computer-Use AgentsOctober 15, 2026 · arXiv
- MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer EnvironmentsOctober 14, 2026 · arXiv
- Towards Safe Autonomy for Computer UseOctober 13, 2026 · arXiv
- Pack Light, CarryOn: Building Object-Oriented Context for Long-Horizon AgentsOctober 13, 2026 · arXiv
- Learning How to Remember: Memory Modality Selection for GUI AgentsOctober 13, 2026 · arXiv