Qwen2.5-Coder is the latest series of Code-Specific Qwen large language models available in [F16, q8_0, q6_K, q4_K_S]
4,209 Pulls 4 Tags Updated 1 year ago
I-quants for qwen2.5-coder-32b-instruct
2,450 Pulls 8 Tags Updated 1 year ago
Qwen2.5-Coder for Roo available in [F16, q8_0, q6_K, q4_K_S]
832 Pulls 4 Tags Updated 1 year ago
Qwen2.5-Coder-32B-Instruct fine-tuned on a decontaminated version of the codeforces dataset.
797 Pulls 7 Tags Updated 1 year ago
I-quants for qwen2.5-coder-32b-instruct-abliterated
815 Pulls 6 Tags Updated 1 year ago
Perfect size for 24GB GPUs!
629 Pulls 1 Tag Updated 1 year ago
Decensored Qwen2.5-Coder-3B-Instruct with 3/100 refusals and near-zero KL divergence via Heretic abliteration.
1,397 Pulls 1 Tag Updated 1 month ago
https://huggingface.co/bartowski/Qwen2.5-Coder-3B-Instruct-abliterated-GGUF
4,470 Pulls 22 Tags Updated 1 year ago
A Custom Qwen2.5-coder:3b-instruct using a Qwen2.5-coder:1.5b model as speculative fill. Primary usage for this model is TabbyML.
248 Pulls 1 Tag Updated 4 months ago