joefamous/
mixtral:rtx4090

52 1 year ago

Mixtral for 24GB GPUs

1 year ago

7e632ed69fa6 · 20GB ·

model
llama
·
46.7B
·
Q3_K_L
template
[INST] {{ .System }} {{ .Prompt }} [/INST]
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
params
{ "num_gpu": 40, "stop": [ "[INST]", "[/INST]" ] }

Readme

No readme