dlasher/ Nemotron-Cascade-2-30B-A3B:IQ4_NL

31 1 month ago

pulled as BF16, requant to IQ4_NL, with combined_en_huge as dataset (English + Coding focus)

tools thinking
... /
template
c1d545bca1bb ยท 197B
{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{ if .Prompt }}<|im_start|>user
{{ .Prompt }}<|im_end|>
{{ end }}<|im_start|>assistant
<think></think>{{ .Response }}<|im_end|>