213 1 year ago

8GB VRAM

ollama run denisavetisyan/saiga_yandexgpt_8b_gguf_q5_k_m

Details

1 year ago

4e6355203de6 · 5.7GB ·

llama
·
8.04B
·
Q5_K_M
{{- range .Messages }}<|start_header_id|>{{ .Role }}<|end_header_id|> {{ .Content }}<|eot_id|> {{- e
{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"

Readme

No readme