okamototk/
llama-swallow

146 1 month ago

Llama Swallow with additional Tool Calling support

tools 8b 70b

Models

View all →

2 models

llama-swallow:8b

4.9GB · 128K context window · Text · 1 month ago

llama-swallow:70b

43GB · 128K context window · Text · 1 month ago

Readme

Llama Swallow Tool Calling Supported Quantized Model for Ollama

After MCP was hot, Tool Calling feature is important to develop AI Agent with various external tools. This Ollama model is added Tool Calling capability for Llama Swallow provided by Institute of Science Tokyo.

This model set is Q4_K_M imatrix quantized model. TFMC/imatrix-dataset-for-japanese-llm is used for imatrix calibration.

Model(Here) Original Model Quantized Model (HF)
llama-swallow:8b Llama-3.1-Swallow-8B-Instruct-v0.5 Llama-3.1-Swallow-8B-Instruct-v0.5-gguf
llama-swallow:70b Llama-3.3-Swallow-70B-Instruct-v0.4 Llama-3.3-Swallow-70B-Instruct-v0.4-imatrix-gguf

License

This model is licensed under “LLAMA 3.1 / 3.3 COMMUNITY LICENSE AGREEMENT” and “Gemma Terms of Use”. Please check license metadata in model for license detail.

This model is Built with Llama.