23 1 week ago

Production-ready copy of gemma4:31b-hf-qat-think (Unsloth QAT UD-Q4_K_XL, 30.7B) with battle-tested defaults baked in: temperature 1.0, top_p 0.95, top_k 64, num_ctx 48384. Sized for a single 24 GB GPU.

vision tools thinking
f56e8459650d ยท 159B
{{ if .System }}<bos><|turn>system
{{ .System }}<turn|>
{{ end }}{{ if .Prompt }}<|turn>user
{{ .Prompt }}<turn|>
{{ end }}<|turn>model
{{ .Response }}<turn|>