Base on the leaked Mistral Medium 70B. This model is a 2bit imatrix quant that runs great on consumer hardware from https://huggingface.co/KnutJaegersberg/awesome-2bit-gguf HF repo collection by Knut Jägersberg @JagersbergKnut on X -w/Permission
70B
122 Pulls Updated 6 months ago
1 Tag
87b0e0f066f4 • 20GB •
Updated 7 months ago