sam860/
qwen3:8b

724 1 week ago

Useful Unsloth-DQ2 quants of the smaller qwen3 models

tools thinking 1.7b 4b 8b
... /
params
a06379877ca0 · 205B
{
"min_p": 0,
"num_predict": 32768,
"repeat_penalty": 1,
"stop": [
"<|im_start|>",
"<|im_end|>"
],
"temperature": 0.6,
"top_k": 20,
"top_p": 0.95
}