mistral 7B for execution only in CPU
3,451 Pulls Updated 9 months ago
Updated 9 months ago
9 months ago
336ff23b3d5f · 4.1GB
model
archllama
·
parameters7.25B
·
quantizationQ4_0
4.1GB
params
{
"num_gpu": 0,
"stop": [
"[INST]",
"[/INST]"
]
}
42B
template
[INST] {{ if .System }}{{ .System }} {{ end }}{{ .Prompt }} [/INST]
67B
license
Apache License
Version 2.0, January 2004
11kB
Readme
Personal modification of parameters to run this model easily in the CPU only.