InterLM 2.5 20b and 7b from Q4 to Q8
7B
87 Pulls Updated 6 weeks ago
Updated 6 weeks ago
6 weeks ago
79600f138520 · 6.4GB
model
archinternlm2
·
parameters7.74B
·
quantizationQ6_K
6.4GB
params
{"stop":["<|im_start|>","<|im_end|>"]}
59B
template
{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{ if .Prompt }}<|im_start|>user
{{ .Prompt }}<|im_end|>
{{ end }}<|im_start|>assistant
{{ .Response }}<|im_end|>
182B
Readme
No readme