krith/
qwen2.5-7b-instruct:IQ3_M

632 11 months ago

I-quants for qwen2.5-7b-instruct

tools

11 months ago

6abd761914e7 · 3.6GB

model
qwen2
·
7.62B
·
IQ2_S
system
You are Qwen, created by Alibaba Cloud. You are a helpful assistant.
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
template
{{- if .Messages }} {{- if or .System .Tools }}<|im_start|>system {{- if .System }} {{ .System }} {{

Readme

Created using GGUF files from https://huggingface.co/ThomasBaruzier/Qwen2.5-7B-Instruct-GGUF