aliafshar/
gemma3-it-qat-tools

1,566 3 months ago

Gemma3 instruction-tuned and quantized with tool/functions using a faithful representation of the Google DeepMind recommended tool calling methodology. Runs remarkably well on old GPUs and CPU.

vision tools 1b 4b 12b 27b

Models

View all →

5 models

gemma3-it-qat-tools:latest

8.9GB · 128K context window · Text, Image · 3 months ago

gemma3-it-qat-tools:1b

1.0GB · 32K context window · Text · 3 months ago

gemma3-it-qat-tools:4b

4.0GB · 128K context window · Text, Image · 3 months ago

gemma3-it-qat-tools:12b

latest

8.9GB · 128K context window · Text, Image · 3 months ago

gemma3-it-qat-tools:27b

18GB · 128K context window · Text, Image · 3 months ago

Readme

Gemma3 instruction-tuned and quantized with tool/functions using a faithful representation of the Google DeepMind recommended tool calling methodology. Runs remarkably well on old GPUs and CPU.

References:

See the original Gemma3 information here:

https://ollama.com/library/gemma3