First upload of a huggingface model that has been quantized to use 4-bit weights (Q4_0).

2 2 months ago

... /
template
a015bc01e22d · 190B
{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{ if .Prompt }}<|im_start|>user
{{ .Prompt }}<|im_end|>
{{ end }}<|im_start|>assistant
{{ .Response }}<|im_end|>