ScrambieBambie/
TheDrummer-Anubis-70B-v1.1-Q4_K_L:70b

13 2 months ago

TheDrummer/Anubis-70B-v1.1 (Q4_K_L)

tools 70b

2 months ago

df5fae258fa6 · 43GB

model
llama
·
70.6B
·
Q4_K_M
template
{{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|> {{- if .System }} {{ .System }
params
{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"

Readme

Choose the model from the list and then use the link (or click on the copy icon next to it’s name) - The link on the main site in the top right will not work!!!

(Q4_K_L) - Quants made using imatrix option, uses Q8_0 for embed and output weights.

Original model: https://huggingface.co/TheDrummer/Anubis-70B-v1.1

Quants from: https://huggingface.co/bartowski/TheDrummer_Anubis-70B-v1.1-GGUF

CHECK OUT THIS BEST CHARACTER CHAT APP !!! Hammer AI (offline/local & online) - Chat with AI characters for free. Uncensored and private. https://www.hammerai.com/