80 1 week ago

Unsloth's Gemma4 QAT models with enforced context windows.

vision tools thinking
ollama run justingtzk/gemma-4-31B-it-qat-GGUF:UD-Q4_K_XL_128K

Details

1 week ago

61f68faaaf7a · 18GB ·

gemma4
·
30.7B
·
Q4_0
clip
·
576M
·
BF16
{{ if .System }}<bos><|turn>system {{ .System }}<turn|> {{ end }}{{ if .Prompt }}<|turn>user {{ .Pro
{ "num_ctx": 131072, "stop": [ "<turn|>" ] }

Readme

None of these models were created by myself and are just the weights form Unsloth’s Gemma4 QAT models with enforced context window.

Ref: [https://huggingface.co/unsloth]