mannix / mixtral_7bx2_moe

A high-quality Mixture of Experts (MoE) model with open weights by Mistral AI.

13B

172 Pulls Updated 5 months ago

5 months ago

353f1266e0bf · 4.8GB

model
llama
·
12.9B
·
Q2_K
params
{"stop":["[INST]","[/INST]"]}
template
"[INST] {{ .System }} {{ .Prompt }} [/INST]"

Readme

The Mixtral-7Bx2 Large Language Model (LLM) is a pretrained generative Sparse Mixture of Experts.

@HuggingFace https://huggingface.co/ManniX-ITA/Mixtral_7Bx2_MoE-GGUF