InterLM 2.5 20b and 7b from Q4 to Q8
7B
87 Pulls Updated 6 weeks ago
Updated 6 weeks ago
6 weeks ago
1a27c4c562d6 · 16GB
model
archinternlm2
·
parameters19.9B
·
quantizationQ6_K
16GB
params
{"stop":["<|im_start|>","<|im_end|>"]}
59B
template
{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{ if .Prompt }}<|im_start|>user
{{ .Prompt }}<|im_end|>
{{ end }}<|im_start|>assistant
{{ .Response }}<|im_end|>
182B
Readme
No readme