422 1 year ago

quantization of perlthoughts/Mistral-7B-Instruct-v0.2-2x7B-MoE

1 year ago

ad95f022607a · 7.3GB ·

llama
·
12.9B
·
Q4_K_M
{ "num_ctx": 32000, "stop": [ "[INST]", "[/INST]" ] }
[INST] {{ .System }} {{ .Prompt }} [/INST]

Readme

No readme