ScrambieBambie/
Feral-Allura-70B-Q4_K_M:70b

9 2 months ago

Mawdistical/Feral-Allura-70B-GGUF (Q4_K_M)

tools 70b

2 months ago

0beac1cc810d · 43GB

model
llama
·
70.6B
·
Q4_K_M
template
{{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|> {{- if .System }} {{ .System }
params
{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"

Readme

Choose the model from the list and then use the link (or click on the copy icon next to it’s name) - The link on the main site in the top right will not work!!!

(Q4_K_M)

Original model: https://huggingface.co/Mawdistical/Feral-Allura-70B-GGUF

Quants from: https://huggingface.co/Mawdistical/Feral-Allura-70B-GGUF

CHECK OUT THIS BEST CHARACTER CHAT APP !!! Hammer AI (offline/local & online) - Chat with AI characters for free. Uncensored and private. https://www.hammerai.com/