doreilly / minicpm26_q4_k_m

model

archqwen2

·

parameters7.61B

·

quantizationQ4_K_M

4.7GB

projector

archclip

·

parameters504M

·

quantizationF16

1.0GB

params

{"num_ctx":2048,"stop":["<|endoftext|>","<|im_end|>"]}

75B

template

{{ if .System }}<|im_start|>system {{ .System }}<|im_end|>{{ end }} {{ if .Prompt }}<|im_start|>user {{ .Prompt }}<|im_end|>{{ end }} <|im_start|>assistant<|im_end|> {{ .Response }}<|im_end|>

196B