finalend/
smaug-llama3-70b-abliterated-v3:q4_K_M

94 1 year ago

1 year ago

5b86985f74e1 · 43GB ·

model
llama
·
70.6B
·
Q4_K_M
license
META LLAMA 3 COMMUNITY LICENSE AGREEMENT Meta Llama 3 Version Release Date: April 18, 2024 “Agreem
params
{ "num_keep": 24, "stop": [ "<|start_header_id|>", "<|end_header_id|>",
template
{{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Pr

Readme

Converted to GGUF (fp16). Quantized to Q4_K_M.

Safetensors source: https://huggingface.co/failspy/Smaug-Llama-3-70B-Instruct-abliterated-v3