Multimodal Embodied Agents: A Unified Capability-centric Perspective from Computer-Use to Robot-Use
Yanzhe Chen , Ziyi Yang , Jifeng Zhu , Qiming Huang , Ruihe An , Peiyao Xu , Hesen Yang , Runda Liu , Chang Gong , Zhijun Cao , Zechen Bai , Wenzheng Zeng , Yiqi Lin , Guoqiang Liang , Kevin Yuchen Ma , Kevin Qinghong Lin , Mike Zheng Shou
- 🏛 Institutions
- NUS
- 📅 Date
- October 21, 2026
- 📑 Publisher
- arXiv
- 💻 Env
- 🔑 Keywords
TLDR
Presents PAPAV, a capability-centric framework unifying multimodal computer-use agents and robotic systems across perception, anticipation, planning, action, and verification across 64 benchmarks.
Related papers (8)
- What Does "Now" Mean to Your Computer-Use Agent? Stale Screenshots, Page Loads, and Which Check to Run Before a ClickOctober 29, 2026 · arXiv
- Lost in Recovery: Demystifying Recovery Behavior of Computer-Use Agents via Goal-Oriented Action ReplayOctober 20, 2026 · arXiv
- CUA-Recovery: Benchmarking Error Recovery in Long-Horizon Computer-Use AgentsOctober 20, 2026 · arXiv
- Interaction-as-a-JudgeOctober 13, 2026 · arXiv
- SoftwareGym: Scaling Computer-Use Agent Training with Diverse Synthesized Software EnvironmentsOctober 8, 2026 · arXiv
- Secure-CUA: Controlling Untrusted Influence in Computer-Use AgentsOctober 7, 2026 · arXiv
- PlaySuite: A Large-Scale Benchmark for Interactive Visual IntelligenceOctober 5, 2026 · arXiv
- Control OSWorld: An AI Control Environment for GUI Computer Use AgentsOctober 2, 2026 · arXiv