lly/QwQ-32B-Q3K

lly/

QwQ-32B-Q3K_S:latest

368 Downloads Updated 8 months ago

tools

Updated 8 months ago

8 months ago

e7b0d2264d44 · 14GB ·

archqwen2

parameters32.8B

quantizationQ3_K_S

14GB

{{- if or .System .Tools }}<|im_start|>system {{- if .System }} {{ .System }} {{- end }} {{- if .Too

1.2kB

Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US

11kB

{ "stop": [ "<|im_start|>", "<|im_end|>" ], "temperature": 0.6 }

77B

Readme

32B Q3_K_S GGUF quant from bartowski which tightly fits in 16GB GPUs.