mistral 7B for execution only in CPU
286 Pulls Updated 4 months ago
Updated 4 months ago
4 months ago
336ff23b3d5f · 4.1GB
model
archllama
·
parameters7.25B
·
quantizationQ4_0
4.1GB
params
{"num_gpu":0,"stop":["[INST]","[/INST]"]}
42B
template
[INST] {{ if .System }}{{ .System }} {{ end }}{{ .Prompt }} [/INST]
67B
license
Apache License
Version 2.0, January 2004
11kB
Readme
Personal modification of parameters to run this model easily in the CPU only.