imatrix quants of Mixtral
8x7B
20 Pulls Updated 6 months ago
Updated 6 months ago
6 months ago
6388d0edd837 · 12GB
model
archllama
·
parameters46.7B
·
quantizationIQ2_XXS
12GB
params
{"stop":["[INST]","[/INST]"]}
30B
template
[INST] {{ .System }} {{ .Prompt }} [/INST]
42B
system
You are a helpful assistant.
29B