impactframes / mistral_alpha_xs

Base on the leaked Mistral Medium 70B. This model is a 2bit imatrix quant that runs great on consumer hardware from https://huggingface.co/KnutJaegersberg/awesome-2bit-gguf HF repo collection by Knut Jägersberg @JagersbergKnut on X -w/Permission

70B

122 Pulls Updated 6 months ago

7 months ago

87b0e0f066f4 · 20GB

model
llama
·
69.0B
·
IQ2_XS
template
[INST] {{ .System }} {{ .Prompt }} [/INST]
params
{"stop":["[INST]","\"[/INST]\""]}

Readme

Mistral license https://huggingface.co/KnutJaegersberg/awesome-2bit-gguf