krith/
qwen2.5-7b-instruct:IQ3_XXS

632 11 months ago

I-quants for qwen2.5-7b-instruct

tools

11 months ago

5c7720507f21 · 3.1GB

model
qwen2
·
7.62B
·
IQ3_XXS
system
You are Qwen, created by Alibaba Cloud. You are a helpful assistant.
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
template
{{- if .Messages }} {{- if or .System .Tools }}<|im_start|>system {{- if .System }} {{ .System }} {{

Readme

Created using GGUF files from https://huggingface.co/ThomasBaruzier/Qwen2.5-7B-Instruct-GGUF