fauxpaslife/ Mellum2-Thinking-A2.5B-12B:latest

1,106 1 month ago

Mellum 2 Thinking is a Mixture-of-Experts reasoning model (64 experts, 8 activated per token, 131,072-token context) that emits its chain of thought. (Q4_K_M)

... /
template
eb91e674f70f ยท 186B
{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{ if .Prompt }}<|im_start|>user
{{ .Prompt }}<|im_end|>
{{ end }}<|im_start|>assistant
{{ .Response }}<|im_end|>