krith/
qwen2.5-coder-14b-instruct-abliterated

94 11 months ago

I-quants for qwen2.5-coder-14b-instruct-abliterated

tools

Models

View all →

6 models

qwen2.5-coder-14b-instruct-abliterated:IQ3_M

6.9GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:IQ2_XS

4.7GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:IQ2_S

5.0GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:IQ2_M

5.4GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:IQ3_XS

6.4GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:IQ4_XS

8.1GB · 32K context window · Text · 11 months ago

Readme

Created using GGUF files from https://huggingface.co/bartowski/Qwen2.5-Coder-14B-Instruct-abliterated-GGUF