krith/
qwen2.5-7b-instruct

664 1 year ago

I-quants for qwen2.5-7b-instruct

tools

Models

View all →

11 models

qwen2.5-7b-instruct:IQ3_M

3.6GB · 32K context window · Text · 1 year ago

qwen2.5-7b-instruct:IQ1_S

1.9GB · 32K context window · Text · 1 year ago

qwen2.5-7b-instruct:IQ1_M

2.0GB · 32K context window · Text · 1 year ago

qwen2.5-7b-instruct:IQ2_XXS

2.3GB · 32K context window · Text · 1 year ago

qwen2.5-7b-instruct:IQ2_XS

2.5GB · 32K context window · Text · 1 year ago

qwen2.5-7b-instruct:IQ2_S

2.6GB · 32K context window · Text · 1 year ago

qwen2.5-7b-instruct:IQ2_M

2.8GB · 32K context window · Text · 1 year ago

qwen2.5-7b-instruct:IQ3_XXS

3.1GB · 32K context window · Text · 1 year ago

qwen2.5-7b-instruct:IQ3_XS

3.3GB · 32K context window · Text · 1 year ago

qwen2.5-7b-instruct:IQ3_S

3.5GB · 32K context window · Text · 1 year ago

qwen2.5-7b-instruct:IQ4_XS

4.2GB · 32K context window · Text · 1 year ago

Readme

Created using GGUF files from https://huggingface.co/ThomasBaruzier/Qwen2.5-7B-Instruct-GGUF