impactframes/
mistral_alpha_xs:latest

177 1 year ago

Base on the leaked Mistral Medium 70B. This model is a 2bit imatrix quant that runs great on consumer hardware from https://huggingface.co/KnutJaegersberg/awesome-2bit-gguf HF repo collection by Knut Jägersberg @JagersbergKnut on X -w/Permission

... /
params
5a94b79ddbb8 · 34B
{
"stop": [
"[INST]",
"\"[/INST]\""
]
}