dimweb/
ilyagusev-saiga_llama3_8b:Q6_K

319 1 year ago

kto_v5_Q4_K, Q6_K

1 year ago

f7ee0554656c · 6.6GB ·

model
llama
·
8.03B
·
Q6_K
params
{ "num_ctx": 8192, "num_keep": 24, "repeat_penalty": 1.1, "stop": [ "<|start
template
{{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Pr
system
Ты — Сайга, русскоязычный автоматический ассистент. Т

Readme

https://huggingface.co/IlyaGusev/saiga_llama3_8b_gguf/tree/kto

https://huggingface.co/VlSav/saiga_llama3_8b-Q6_K-GGUF