lly/ QwQ-32B-Q3K_S:latest

381 1 year ago

tools
ollama run lly/QwQ-32B-Q3K_S

Details

1 year ago

e7b0d2264d44 · 14GB ·

qwen2
·
32.8B
·
Q3_K_S
{{- if or .System .Tools }}<|im_start|>system {{- if .System }} {{ .System }} {{- end }} {{- if .Too
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
{ "stop": [ "<|im_start|>", "<|im_end|>" ], "temperature": 0.6 }

Readme

32B Q3_K_S GGUF quant from bartowski which tightly fits in 16GB GPUs.