krith/
qwen2.5-coder-32b-instruct:IQ3_XS

1,884 9 months ago

I-quants for qwen2.5-coder-32b-instruct

tools

9 months ago

1c1dbf2ef7d2 · 14GB

model
qwen2
·
32.8B
·
IQ3_XS
system
You are Qwen, created by Alibaba Cloud. You are a helpful assistant.
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
template
{{- if .Suffix }}<|fim_prefix|>{{ .Prompt }}<|fim_suffix|>{{ .Suffix }}<|fim_middle|> {{- else if .M

Readme

Created using GGUF files from https://huggingface.co/bartowski/Qwen2.5-Coder-32B-Instruct-GGUF