269 1 year ago

10GB VRAM

ollama run denisavetisyan/saiga_yandexgpt_8b_gguf_q8

Details

1 year ago

bdddaa345b71 · 8.5GB ·

llama
·
8.04B
·
Q8_0
{{- range .Messages }}<|start_header_id|>{{ .Role }}<|end_header_id|> {{ .Content }}<|eot_id|> {{- e
{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"

Readme

No readme