steamdj/mistral-cpu-only

steamdj/

mistral-cpu-only:latest

4,442 Downloads Updated 1 year ago

mistral 7B for execution only in CPU

Updated 1 year ago

1 year ago

336ff23b3d5f · 4.1GB ·

archllama

parameters7.25B

quantizationQ4_0

4.1GB

{ "num_gpu": 0, "stop": [ "[INST]", "[/INST]" ] }

42B

Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US

11kB

[INST] {{ if .System }}{{ .System }} {{ end }}{{ .Prompt }} [/INST]

67B

Personal modification of parameters to run this model easily in the CPU only.