Proposer-Agent-Evaluator (PAE): Autonomous Skill Discovery For Foundation Model Internet Agents

Yifei Zhou , Qianlan Yang , Kaixiang Lin , Min Bai , Xiong Zhou , Yu-Xiong Wang , Sergey Levine , Li Erran Li

🏛 Institutions: UC Berkeley , UIUC , Amazon
📅 Date: December 17, 2024
📑 Publisher: ICML 2025 (Poster)
💻 Env: Web
🔑 Keywords: framework reinforcement learning skill discovery autonomous task proposal VLM-based success evaluator PAE

TLDR

PAE is a web-agent learning system that lets foundation-model agents autonomously propose tasks, attempt them, and score the resulting trajectories with a VLM-based evaluator. By turning those evaluations into RL signals, it improves zero-shot generalization on unseen websites and tasks for vision-based internet agents.

Open paper arXiv OpenReview Publisher Code Report issue