okamototk/
llama-swallow:8b

146 1 month ago

Llama Swallow with additional Tool Calling support

tools 8b 70b

1 month ago

e61a4c864d2d · 4.9GB ·

model
llama
·
8.03B
·
Q4_K_M
license
LLAMA 3.1 COMMUNITY LICENSE AGREEMENT Llama 3.1 Version Release Date: July 23, 2024 “Agreement”
template
{{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|> {{- if .System }} {{ .System }
license
Gemma Terms of Use Last modified: March 24, 2025 By using, reproducing, modifying, distributing, per
params
{ "repeat_penalty": 1.1, "temperature": 0.6, "top_p": 0.9 }

Readme

Llama Swallow Tool Calling Supported Quantized Model for Ollama

After MCP was hot, Tool Calling feature is important to develop AI Agent with various external tools. This Ollama model is added Tool Calling capability for Llama Swallow provided by Institute of Science Tokyo.

This model set is Q4_K_M imatrix quantized model. TFMC/imatrix-dataset-for-japanese-llm is used for imatrix calibration.

Model(Here) Original Model Quantized Model (HF)
llama-swallow:8b Llama-3.1-Swallow-8B-Instruct-v0.5 Llama-3.1-Swallow-8B-Instruct-v0.5-gguf
llama-swallow:70b Llama-3.3-Swallow-70B-Instruct-v0.4 Llama-3.3-Swallow-70B-Instruct-v0.4-imatrix-gguf

License

This model is licensed under “LLAMA 3.1 / 3.3 COMMUNITY LICENSE AGREEMENT” and “Gemma Terms of Use”. Please check license metadata in model for license detail.

This model is Built with Llama.