Updated 4 weeks ago
4 weeks ago
17604fc0bd6b · 18GB
model
archqwen2
·
parameters32.8B
·
quantizationIQ1_M
18GB
params
{
"stop": [
"<|im_start|>",
"<|im_end|>"
],
"temperature": 0.6,
"top
90B
template
{{- if .Suffix }}<|fim_prefix|>{{ .Prompt }}<|fim_suffix|>{{ .Suffix }}<|fim_middle|>
{{- else if .M
1.6kB
license
Apache License
Version 2.0, January 2004
11kB
Readme
I added the :short, medium, and long tags, each one have a system prompt designed to keep the thinking short, medium or long. It also sets the default context length to 16k.
GGUF from bartowski/QwQ-32B-GGUF.
Original model from Qwen/QwQ-32B.
The parameters are from the recommended Usage Guidelines.