InterLM 2.5 20b and 7b from Q4 to Q8
7B
87 Pulls Updated 6 weeks ago
Updated 6 weeks ago
6 weeks ago
d2841f08bf32 · 21GB
model
archinternlm2
·
parameters19.9B
·
quantizationQ8_0
21GB
params
{"stop":["<|im_start|>","<|im_end|>"]}
59B
template
{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{ if .Prompt }}<|im_start|>user
{{ .Prompt }}<|im_end|>
{{ end }}<|im_start|>assistant
{{ .Response }}<|im_end|>
182B
Readme
No readme