dagbs/
qwen2.5-coder-7b-instruct-abliterated

796 11 months ago

https://huggingface.co/bartowski/Qwen2.5-Coder-7B-Instruct-abliterated-GGUF

tools

Models

View all →

20 models

qwen2.5-coder-7b-instruct-abliterated:latest

4.7GB · 32K context window · Text · 11 months ago

qwen2.5-coder-7b-instruct-abliterated:iq3_m

3.6GB · 32K context window · Text · 11 months ago

qwen2.5-coder-7b-instruct-abliterated:q2_k_l

3.5GB · 32K context window · Text · 11 months ago

qwen2.5-coder-7b-instruct-abliterated:q3_k_xl

4.6GB · 32K context window · Text · 11 months ago

qwen2.5-coder-7b-instruct-abliterated:q4_k_l

5.1GB · 32K context window · Text · 11 months ago

qwen2.5-coder-7b-instruct-abliterated:q5_k_l

5.8GB · 32K context window · Text · 11 months ago

qwen2.5-coder-7b-instruct-abliterated:q6_k_l

6.5GB · 32K context window · Text · 11 months ago

qwen2.5-coder-7b-instruct-abliterated:q2_k

3.0GB · 32K context window · Text · 11 months ago

qwen2.5-coder-7b-instruct-abliterated:q3_k_s

3.5GB · 32K context window · Text · 11 months ago

qwen2.5-coder-7b-instruct-abliterated:q3_k_m

3.8GB · 32K context window · Text · 11 months ago

qwen2.5-coder-7b-instruct-abliterated:q3_k_l

4.1GB · 32K context window · Text · 11 months ago

qwen2.5-coder-7b-instruct-abliterated:q4_0

4.4GB · 32K context window · Text · 11 months ago

qwen2.5-coder-7b-instruct-abliterated:q4_k_s

4.5GB · 32K context window · Text · 11 months ago

qwen2.5-coder-7b-instruct-abliterated:q4_k_m

4.7GB · 32K context window · Text · 11 months ago

qwen2.5-coder-7b-instruct-abliterated:q5_k_m

5.4GB · 32K context window · Text · 11 months ago

qwen2.5-coder-7b-instruct-abliterated:q6_k

6.3GB · 32K context window · Text · 11 months ago

qwen2.5-coder-7b-instruct-abliterated:q8_0

8.1GB · 32K context window · Text · 11 months ago

qwen2.5-coder-7b-instruct-abliterated:iq2_m

2.8GB · 32K context window · Text · 11 months ago

qwen2.5-coder-7b-instruct-abliterated:iq3_xs

3.3GB · 32K context window · Text · 11 months ago

qwen2.5-coder-7b-instruct-abliterated:iq4_xs

4.2GB · 32K context window · Text · 11 months ago

Readme

No readme