JEF-Hinter: Leveraging Offline Knowledge for Improving Web Agents Adaptation

Hadi Nekoei, Aman Jaiswal, Patrice Bechard, Oleh Shliazhko, Orlando Marquez Ayala, Mathieu Reymond, Massimo Caccia, Alexandre Drouin, Sarath Chandar, Alexandre Lacoste

🏛 Institutions: ServiceNow Research, Mila, Université de Montréal, Dalhousie University, Polytechnique Montréal, Canada CIFAR AI Chair
📅 Date: October 5, 2025
📑 Publisher: arXiv
💻 Env: Web
🔑 Keywords: offline trajectories hint retrieval failed trajectories WebArena-Lite JEF-Hinter

TLDR

JEF-Hinter distills offline web-agent traces into compact, context-aware hints that can be retrieved at inference time instead of relying on online exploration or large demonstration sets. It uses both successful and failed trajectories, highlights decisive steps with a zooming mechanism, and outperforms strong human- and document-hint baselines on MiniWoB++, WorkArena-L1, and WebArena-Lite.

Open paper arXiv Edit on GitHub Report issue