ordis/
mixtral:8x7b-instruct-v0.1-q4_K_M-64k

3 1 year ago

1 year ago

04f7af668d11 · 26GB ·

model
llama
·
46.7B
·
Q4_K_M
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
template
[INST] {{ if .System }}{{ .System }} {{ end }}{{ .Prompt }} [/INST]
params
{ "num_ctx": 65535, "num_predict": -2, "stop": [ "[INST]", "[/INST]"

Readme

No readme