dagbs/
dolphin-2.9.2-qwen2-7b:iq4_xs

699 1 year ago

1 year ago

b3368d4a22c6 · 4.2GB ·

model
qwen2
·
7.62B
·
IQ1_M
template
{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user
params
{ "num_ctx": 131072, "stop": [ "<|im_start|>", "<|im_end|>", "<|endo

Readme

original gguf on hf cognitivecomputations/dolphin-2.9.2-qwen2-7b-gguf