driftfurther/
qwq-unsloth:latest

442 5 months ago

qwq with unsloth recommended settings, context window fitting into 24GB VRAM

tools

5 months ago

430d95c5c788 · 20GB

model
qwen2
·
32.8B
·
Q4_K_M
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
template
{{- if or .System .Tools }}<|im_start|>system {{- if .System }} {{ .System }} {{- end }} {{- if .Too
params
{ "min_p": 0.1, "num_ctx": 12000, "repeat_penalty": 1.1, "stop": [ "<|im_sta

Readme

No readme