4,442 1 year ago

mistral 7B for execution only in CPU

1 year ago

336ff23b3d5f · 4.1GB ·

llama
·
7.25B
·
Q4_0
{ "num_gpu": 0, "stop": [ "[INST]", "[/INST]" ] }
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
[INST] {{ if .System }}{{ .System }} {{ end }}{{ .Prompt }} [/INST]

Readme

Personal modification of parameters to run this model easily in the CPU only.