mistral 7B for execution only in CPU
282 Pulls Updated 4 months ago
Updated 5 months ago
5 months ago
745b30a7ff41 · 4.1GB
model
archllama
·
parameters7.24B
·
quantizationQ4_0
4.1GB
template
[INST] {{ .System }} {{ .Prompt }} [/INST]
42B
params
{"num_gpu":0,"stop":["[INST]","[/INST]"]}
42B
license
Apache License
Version 2.0, January 2004
11kB
Readme
Personal modification of parameters to run this model easily in the CPU only.