songfy/
qwen2:72B-awq-q40

79 1 year ago

1 year ago

5e2e2eabd19e · 41GB

model
qwen2
·
72.7B
·
Q4_0
template
{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user
params
{ "num_predict": 102400, "repeat_penalty": 1.05, "stop": [ "<|im_start|>",

Readme

No readme