i don't know why the version from TheBloke has no q8_0 file but. oh well!
92 Pulls Updated 9 months ago
Updated 9 months ago
9 months ago
d3e71711032a · 7.7GB
model
archllama
·
parameters7.24B
·
quantizationQ8_0
7.7GB
params
{"num_ctx":16384,"stop":["\u003c|im_start|\u003e","\u003c|im_end|\u003e"]}
75B
template
<|im_start|>system
{{ .System }}<|im_end|>
<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start
111B