First upload of a huggingface model that has been quantized to use 4-bit weights (Q4_0).

9B

2 Pulls Updated 2 weeks ago

a015bc01e22d · 190B
{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user {{ .Prompt }}<|im_end|> {{ end }}<|im_start|>assistant {{ .Response }}<|im_end|>