krith/
qwen2.5-32b-instruct:IQ3_XXS

474 1 year ago

I-quants for qwen2.5-32b-instruct

tools

1 year ago

e39c4029b9ff · 13GB ·

model
qwen2
·
32.8B
·
IQ3_XXS
system
You are Qwen, created by Alibaba Cloud. You are a helpful assistant.
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
template
{{- if .Messages }} {{- if or .System .Tools }}<|im_start|>system {{- if .System }} {{ .System }} {{

Readme

Created using GGUF files from https://huggingface.co/ThomasBaruzier/Qwen2.5-32B-Instruct-GGUF