qwq with unsloth recommended settings, context window fitting into 24GB VRAM
tools
340 Pulls Updated 5 weeks ago
Updated 5 weeks ago
5 weeks ago
430d95c5c788 · 20GB
model
archqwen2
·
parameters32.8B
·
quantizationQ4_K_M
20GB
params
{
"min_p": 0.1,
"num_ctx": 12000,
"repeat_penalty": 1.1,
"stop": [
"<|im_sta
150B
template
{{- if or .System .Tools }}<|im_start|>system
{{- if .System }}
{{ .System }}
{{- end }}
{{- if .Too
1.2kB
license
Apache License
Version 2.0, January 2004
11kB
Readme
No readme