driftfurther/
qwq-unsloth:latest

443 6 months ago

qwq with unsloth recommended settings, context window fitting into 24GB VRAM

tools
... /
params
63e9667e6cd8 · 150B
{
"min_p": 0.1,
"num_ctx": 12000,
"repeat_penalty": 1.1,
"stop": [
"<|im_start|>",
"<|im_end|>"
],
"temperature": 0.6,
"top_k": 40,
"top_p": 0.95
}