JEF-Hinter: Leveraging Offline Knowledge for Improving Web Agents Adaptation

Hadi Nekoei , Aman Jaiswal , Patrice Bechard , Oleh Shliazhko , Orlando Marquez Ayala , Mathieu Reymond , Massimo Caccia , Alexandre Drouin , Sarath Chandar , Alexandre Lacoste

🏛 Institutions: ServiceNow Research , Mila , Université de Montréal , Dalhousie University , Polytechnique Montréal , Canada CIFAR AI Chair
📅 Date: October 5, 2025
📑 Publisher: arXiv
💻 Env: Web
🔑 Keywords: offline trajectories hint retrieval failed trajectories WebArena-Lite JEF-Hinter

TLDR

JEF-Hinter distills offline web-agent traces into compact, context-aware hints that can be retrieved at inference time instead of relying on online exploration or large demonstration sets. It uses both successful and failed trajectories, highlights decisive steps with a zooming mechanism, and outperforms strong human- and document-hint baselines on MiniWoB++, WorkArena-L1, and WebArena-Lite.

Open paper arXiv Report issue