A custom model of Qwen2.5-coder:7B-Instruct with the Qwen2.5-coder:3B-instruct used as a speculative fill model to speed up inference. Primarily made for TabbyML Usage.
1,706 Pulls 1 Tag Updated 3 months ago
Decensored Qwen2.5-Coder-3B-Instruct with 3/100 refusals and near-zero KL divergence via Heretic abliteration.
1,244 Pulls 1 Tag Updated 1 month ago
FROM ./Qwen2.5-Coder-3B-Instruct-Q4_K_M.gguf TEMPLATE """{{ .Prompt }}""" PARAMETER temperature 0.4 PARAMETER top_p 0.9 PARAMETER top_k 40 PARAMETER repeat_penalty 1.15 PARAMETER mirostat 2 PARAMETER mirostat_eta 0.2 PARAMETER mirostat_tau 5.0 PARAMETER
193 Pulls 1 Tag Updated 3 months ago
https://huggingface.co/bartowski/Qwen2.5-Coder-3B-Instruct-abliterated-GGUF
4,340 Pulls 22 Tags Updated 1 year ago
210 Pulls 1 Tag Updated 1 year ago
Adapted for Cline tool / Roo Code use in VS Code fused model , hybrid of DeepSeekR1 and Qwen2.5 coder, from FuseAI/FuseO1-DeepSeekR1-Qwen2.5-Coder-32B-Preview.
4,923 Pulls 2 Tags Updated 1 year ago
Qwen2.5-Coder is the latest series of Code-Specific Qwen large language models available in [F16, q8_0, q6_K, q4_K_S]
4,145 Pulls 4 Tags Updated 1 year ago
Qwen2.5-Coder for Roo available in [F16, q8_0, q6_K, q4_K_S]
820 Pulls 4 Tags Updated 1 year ago
Qwen2.5-Coder-32B-Instruct fine-tuned on a decontaminated version of the codeforces dataset.
793 Pulls 7 Tags Updated 1 year ago
Qwen2.5 Coder 32B with the corrected 128k context
657 Pulls 1 Tag Updated 1 year ago
This repo contains the instruction-tuned 3B Qwen2.5-Coder model in the GGUF Format: https://huggingface.co/Qwen/Qwen2.5-Coder-3B-Instruct-GGUF/tree/main
278 Pulls 1 Tag Updated 1 year ago
29 Pulls 1 Tag Updated 5 months ago
Perfect size for 24GB GPUs!
628 Pulls 1 Tag Updated 1 year ago
Quantized version of Qwen2.5-32B optimized for tool usage with Cline / Roo Code and complex problem solving.
625 Pulls 1 Tag Updated 1 year ago