decadence/ mellum2.1:12b-a2.5b-thinking-q6_k

5 yesterday

12B — GGUF — sampling | ~8-10 GB

tools thinking
... /
params
3f340a3a3d33 · 101B
{
"stop": [
"<|im_end|>",
"<|im_start|>"
],
"temperature": 0.6,
"top_k": 20,
"top_p": 0.95
}