dagbs/
qwen2.5-coder-3b-instruct-abliterated

802 11 months ago

https://huggingface.co/bartowski/Qwen2.5-Coder-3B-Instruct-abliterated-GGUF

tools

Models

View all →

22 models

qwen2.5-coder-3b-instruct-abliterated:latest

1.9GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:f

6.2GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:iq3_m

1.5GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:q2_k_l

1.4GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:q3_k_xl

1.8GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:q4_k_l

2.0GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:q5_k_l

2.3GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:q6_k_l

2.6GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:q2_k

1.3GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:q3_k_s

1.5GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:q3_k_m

1.6GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:q3_k_l

1.7GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:q4_0

1.8GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:q4_k_s

1.8GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:q4_k_m

1.9GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:q5_k_s

2.2GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:q5_k_m

2.2GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:q6_k

2.5GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:q8_0

3.3GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:iq2_m

1.1GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:iq3_xs

1.4GB · 32K context window · Text · 11 months ago

qwen2.5-coder-3b-instruct-abliterated:iq4_xs

1.7GB · 32K context window · Text · 11 months ago

Readme

No readme