662 11 months ago

Using Q8 to address issues with Q4.

11 months ago

7c8f1d26df7b · 8.5GB

llama
·
8.03B
·
Q8_0
{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"
{{ if .Messages }} {{- if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id

Readme

No readme