ScrambieBambie/
Midnight-Miqu-70B-v1.5-i1_Q4_K_M:70b

32 4 months ago

sophosympatheia/Midnight-Miqu-70B-v1.5 (i1-Q4_K_M)

70b

4 months ago

2391beaee105 · 41GB ·

model
llama
·
69B
·
Q4_K_M
template
[INST] {{ if .System }}{{ .System }} {{ end }}{{ .Prompt }} [/INST]
params
{ "stop": [ "[INST]", "[/INST]" ] }

Readme

Choose the model from the list and then use the link (or click on the copy icon next to it’s name) - The link on the main site in the top right will not work!!!

(i1-Q4_K_M)

Original model: https://huggingface.co/sophosympatheia/Midnight-Miqu-70B-v1.5

Quants from: https://huggingface.co/mradermacher/Midnight-Miqu-70B-v1.5-i1-GGUF

CHECK OUT THIS BEST CHARACTER CHAT APP !!! Hammer AI (offline/local & online) - Chat with AI characters for free. Uncensored and private. https://www.hammerai.com/