zshrc/
llama-3some-8b:Q4_K_M

1,458 1 year ago

TheDrummer/Llama-3SOME-8B-v2-GGUF with proper prompt template

1 year ago

a493a72bb98e · 4.9GB ·

model
llama
·
8.03B
·
Q4_K_M
template
{{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Pr
params
{ "num_keep": 24, "stop": [ "<|start_header_id|>", "<|end_header_id|>",

Readme

https://huggingface.co/TheDrummer/Llama-3SOME-8B-v2-GGUF Updated Updated Jun 26, 2024