449 4 months ago

Gemma3:12b, with added tools, quantized to Q2_K and Q3_K_S for GPU with 8gb Vram or less. Vision module fully working.

tools

4 months ago

3269601481ba · 6.3GB

gemma3
·
12.2B
·
Q3_K_S
Gemma Terms of Use Last modified: February 21, 2024 By using, reproducing, modifying, distributing,
{{- /* System message at the beginning, if there is .System or .Tools */ -}} {{- if or .System .Tool
Gemma Terms of Use Last modified: February 21, 2024 By using, reproducing, modifying, distributing,
{ "stop": [ "<end_of_turn>" ], "temperature": 1, "top_k": 64, "top_p": 0

Readme

No readme