doomgrave/
gemma3-tools:12b-it-q2_K

449 4 months ago

Gemma3:12b, with added tools, quantized to Q2_K and Q3_K_S for GPU with 8gb Vram or less. Vision module fully working.

tools

4 months ago

a2fe5273fa82 · 5.6GB

gemma3
·
12.2B
·
Q2_K
Gemma Terms of Use Last modified: February 21, 2024 By using, reproducing, modifying, distributing,
{{- /* System message at the beginning, if there is .System or .Tools */ -}} {{- if or .System .Tool
{ "stop": [ "<end_of_turn>" ], "temperature": 1, "top_k": 64, "top_p": 0

Readme

No readme