205 11 months ago

https://huggingface.co/bartowski/Qwen2.5-Coder-0.5B-Instruct-abliterated-GGUF

tools

Models

View all →

15 models

qwen2.5-coder-0.5b-instruct-abliterated:latest

398MB · 32K context window · Text · 11 months ago

qwen2.5-coder-0.5b-instruct-abliterated:iq3_m

343MB · 32K context window · Text · 11 months ago

qwen2.5-coder-0.5b-instruct-abliterated:q3_k_xl

369MB · 32K context window · Text · 11 months ago

qwen2.5-coder-0.5b-instruct-abliterated:q4_k_l

latest

398MB · 32K context window · Text · 11 months ago

qwen2.5-coder-0.5b-instruct-abliterated:q5_k_l

420MB · 32K context window · Text · 11 months ago

qwen2.5-coder-0.5b-instruct-abliterated:q6_k_l

506MB · 32K context window · Text · 11 months ago

qwen2.5-coder-0.5b-instruct-abliterated:q3_k_l

369MB · 32K context window · Text · 11 months ago

qwen2.5-coder-0.5b-instruct-abliterated:q4_0

353MB · 32K context window · Text · 11 months ago

qwen2.5-coder-0.5b-instruct-abliterated:q4_k_s

385MB · 32K context window · Text · 11 months ago

qwen2.5-coder-0.5b-instruct-abliterated:q4_k_m

398MB · 32K context window · Text · 11 months ago

qwen2.5-coder-0.5b-instruct-abliterated:q5_k_s

413MB · 32K context window · Text · 11 months ago

qwen2.5-coder-0.5b-instruct-abliterated:q5_k_m

420MB · 32K context window · Text · 11 months ago

qwen2.5-coder-0.5b-instruct-abliterated:q6_k

506MB · 32K context window · Text · 11 months ago

qwen2.5-coder-0.5b-instruct-abliterated:q8_0

531MB · 32K context window · Text · 11 months ago

qwen2.5-coder-0.5b-instruct-abliterated:iq4_xs

349MB · 32K context window · Text · 11 months ago

Readme

No readme