Functionary Small v3.1 is a Llama 3.1 8b based tool calling LLM
53 Pulls Updated 4 weeks ago
Updated 4 weeks ago
4 weeks ago
c1affc7e6d58 · 4.7GB
Readme
license: mit
Model Card for functionary-small-v3.1
This is not an official port
The system prompt is not correct as of now.
This model was based on meta-llama/Meta-Llama-3.1-8B-Instruct, using Meta’s original prompt template as described in: User-defined Custom tool calling
https://github.com/MeetKai/functionary
Functionary is a language model that can interpret and execute functions/plugins.
The model determines when to execute functions, whether in parallel or serially, and can understand their outputs. It only triggers functions as needed. Function definitions are given as JSON Schema Objects, similar to OpenAI GPT function calls.
Key Features
- Intelligent parallel tool use
- Able to analyze functions/tools outputs and provide relevant responses grounded in the outputs
- Able to decide when to not use tools/call functions and provide normal chat response
- Truly one of the best open-source alternative to GPT-4
- Support code interpreter
Acknowledgements
Thank you to the meetkai team for training these models and releasing them. Find their github here and the gguf files this is based on here.