1,177 11 months ago

https://huggingface.co/bartowski/Qwen2.5-Coder-14B-Instruct-abliterated-GGUF

tools

Models

View all →

23 models

qwen2.5-coder-14b-instruct-abliterated:latest

9.0GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:iq3_m

6.9GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:q2_k_l

6.5GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:q3_k_xl

8.6GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:q4_k_l

9.6GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:q5_k_l

11GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:q6_k_l

13GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:q2_k

5.8GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:q3_k_s

6.7GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:q3_k_m

7.3GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:q3_k_l

7.9GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:q4_0

8.5GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:q4_k_s

8.6GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:q4_k_m

9.0GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:q5_k_s

10GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:q5_k_m

11GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:q6_k

12GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:q8_0

16GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:iq2_xs

4.7GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:iq2_s

5.0GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:iq2_m

5.4GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:iq3_xs

6.4GB · 32K context window · Text · 11 months ago

qwen2.5-coder-14b-instruct-abliterated:iq4_xs

8.1GB · 32K context window · Text · 11 months ago

Readme

No readme