Yinr/
qwen2.5-agi:latest

1,549 9 months ago

Qwen2.5 32B uncensored from Karsh-CAI/Qwen2.5-32B-AGI-Q4_K_M-GGUF

32b

9 months ago

a3aba60ac918 · 20GB

model
qwen2
·
32.8B
·
Q4_K_M
template
{{ if .System }}<|im_start|>system {{ .System }}<|im_end|>{{ end }}<|im_start|>user {{ .Prompt }}<|i
params
{ "num_ctx": 4096, "stop": [ "</s>", "USER:", "ASSISTANT:",

Readme

Qwen2.5 32B uncensored

info: https://www.reddit.com/r/LocalLLaMA/comments/1fmn0q4/found_an_uncensored_qwen25_32b

source: https://huggingface.co/Karsh-CAI/Qwen2.5-32B-AGI-Q4_K_M-GGUF