Base on the leaked Mistral Medium 70B. This model is a 2bit imatrix quant that runs great on consumer hardware from https://huggingface.co/KnutJaegersberg/awesome-2bit-gguf HF repo collection by Knut Jägersberg @JagersbergKnut on X -w/Permission
134 Pulls Updated 10 months ago
Updated 10 months ago
10 months ago
87b0e0f066f4 · 20GB
model
archllama
·
parameters69B
·
quantizationIQ2_XS
20GB
params
{
"stop": [
"[INST]",
"\"[/INST]\""
]
}
34B
template
[INST] {{ .System }} {{ .Prompt }} [/INST]
47B