dlasher/ Nemotron-3.5-Lightning-30B-A3B-ENG:IQ4_NL

9 yesterday

pulled as BF16, vocab slice (combined_en_huge) requant to IQ4_NL (combined_en_huge) -- (English + Coding focus) - ~37% faster than unsloth UD-IQ4_NL

tools thinking
... /
template
613e7c1f5876 ยท 286B
{{- if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{- end }}
{{- range .Messages }}
{{- if eq .Role "user" }}<|im_start|>user
{{ .Content }}<|im_end|>
{{- else if eq .Role "assistant" }}<|im_start|>assistant
{{ .Content }}<|im_end|>
{{- end }}
{{- end }}<|im_start|>assistant