41 1 year ago

8GB VRAM

ollama run denisavetisyan/saiga_yandexgpt_8b_gguf_q5_k_s

Details

1 year ago

cca308d8c21f · 5.6GB ·

llama
·
8.04B
·
Q5_K_S
{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"
{{- range .Messages }}<|start_header_id|>{{ .Role }}<|end_header_id|> {{ .Content }}<|eot_id|> {{- e

Readme

No readme