TinyAgent: Function Calling at the Edge

Lutfi Eren Erdogan , Nicholas Lee , Siddharth Jha , Sehoon Kim , Ryan Tabrizi , Suhong Moon , Coleman Richard Charles Hooper , Gopala Anumanchipalli , Kurt Keutzer , Amir Gholami

🏛 Institutions: UC Berkeley , ICSI
📅 Date: September 1, 2024
📑 Publisher: EMNLP 2024 System Demonstrations
💻 Env
🔑 Keywords: framework dataset function calling LLMCompiler quantization TinyAgent

TLDR

TinyAgent is an edge deployment framework for small function-calling language models, paired with a curated training dataset, tool retrieval, and quantization for local inference. Its GUI relevance comes mainly from the MacBook assistant demo and local agent deployment setting, not from a primary contribution to GUI interaction research itself.

Open paper Report issue