Updated 6 weeks ago
6 weeks ago
929552370002 · 18GB
model
archqwen2
·
parameters32.8B
·
quantizationIQ1_M
18GB
params
{
"min_p": 0.1,
"num_ctx": 16384,
"repeat_penalty": 1,
"stop": [
"<|im_start
148B
system
You have unlimited time to think and respond to the user’s question. There is no need to worry abo
822B
template
{{- if .Suffix }}<|fim_prefix|>{{ .Prompt }}<|fim_suffix|>{{ .Suffix }}<|fim_middle|>
{{- else if .M
1.6kB
license
Apache License
Version 2.0, January 2004
11kB
Readme
I added the :short, medium, and long tags, each one have a system prompt designed to keep the thinking short, medium or long. It also sets the default context length to 16k.
GGUF from bartowski/QwQ-32B-GGUF.
Original model from Qwen/QwQ-32B.
The parameters are from the recommended Usage Guidelines.