aliafshar/ gemma3-it-qat-tools

13.3K 1 year ago

Gemma3 instruction-tuned and quantized with tool/functions using a faithful representation of the Google DeepMind recommended tool calling methodology. Runs remarkably well on old GPUs and CPU.

vision tools 1b 4b 12b 27b

5 models

gemma3-it-qat-tools:latest
874cf7413552 • 8.9GB • 128K context window •
Text, Image input • 1 year ago
gemma3-it-qat-tools:1b
9684c551631c • 1.0GB • 32K context window •
Text input • 1 year ago
gemma3-it-qat-tools:4b
564724a43455 • 4.0GB • 128K context window •
Text, Image input • 1 year ago
gemma3-it-qat-tools:12b latest
874cf7413552 • 8.9GB • 128K context window •
Text, Image input • 1 year ago
gemma3-it-qat-tools:27b
e85872e89e88 • 18GB • 128K context window •
Text, Image input • 1 year ago