A set of Mixture of Experts (MoE) model with open weights by Mistral AI in 8x7b and 8x22b parameter sizes.

8x7B 8x22B

296.7K Pulls Updated 4 weeks ago

69 Tags

ed11eda7790d · 30B
{ "stop": [ "[INST]", "[/INST]" ] }