ScrambieBambie/
Midnight-Miqu-103B-v1.5-i1-Q4_K_S:103b

36 4 months ago

FluffyKaeloky/Midnight-Miqu-103B-v1.5 (i1-Q4_K_S)

103b

4 months ago

ff4268884f0d · 59GB ·

model
llama
·
103B
·
Q4_K_S
params
{ "stop": [ "[INST]", "[/INST]" ] }
template
[INST] {{ if .System }}{{ .System }} {{ end }}{{ .Prompt }} [/INST]

Readme

Choose the model from the list and then use the link (or click on the copy icon next to it’s name) - The link on the main site in the top right will not work!!!

(i1-Q4_K_S)

Original model: https://huggingface.co/FluffyKaeloky/Midnight-Miqu-103B-v1.5

Quants from: https://huggingface.co/mradermacher/Midnight-Miqu-103B-v1.5-i1-GGUF

CHECK OUT THIS BEST CHARACTER CHAT APP !!! Hammer AI (offline/local & online) - Chat with AI characters for free. Uncensored and private. https://www.hammerai.com/