OSReward: Instituting Standardized Evaluation for Cross-Platform Computer-Use Reward Models

Qiushi Sun , Kanzhi Cheng , Yian Wang , Bowen Yang , Hang Yan , Liheng Chen , Fangzhi Xu , Zichen Ding , Nuo Chen , Jialin Cao , Xingdong Gong , Zehao Li , Kaiming Jin , Xinfeng Yuan , Zhoumianze Liu , Jingyang Gong , Zhangyue Yin , Jiahui Gao , Zhiyong Wu , Tianbao Xie , Jianbing Zhang , Ben Kao , Lingpeng Kong

🏛 Institutions: Unknown
📅 Date: July 30, 2026
📑 Publisher: arXiv
💻 Env: Desktop Mobile Web
🔑 Keywords: benchmark reward model trajectory evaluation OSReward

TLDR

OSReward evaluates vision-language reward models for computer-use trajectories across platforms, including a hard subset and fine-grained efficiency/alignment assessment. It also releases OS-Shepherd, an open corpus and reward-model family for lower-cost trajectory judgment.

Open paper arXiv Report issue