dagbs/
qwen2.5-coder-7b-instruct-abliterated

802 11 months ago

https://huggingface.co/bartowski/Qwen2.5-Coder-7B-Instruct-abliterated-GGUF

tools

20 models

qwen2.5-coder-7b-instruct-abliterated:latest
54157071c712 • 4.7GB • 32K context window •
Text input • 11 months ago
qwen2.5-coder-7b-instruct-abliterated:iq3_m
bbe8da67dd1c • 3.6GB • 32K context window •
Text input • 11 months ago
qwen2.5-coder-7b-instruct-abliterated:q2_k_l
14323933bd58 • 3.5GB • 32K context window •
Text input • 11 months ago
qwen2.5-coder-7b-instruct-abliterated:q3_k_xl
e88d799b1494 • 4.6GB • 32K context window •
Text input • 11 months ago
qwen2.5-coder-7b-instruct-abliterated:q4_k_l
9a1b72e21445 • 5.1GB • 32K context window •
Text input • 11 months ago
qwen2.5-coder-7b-instruct-abliterated:q5_k_l
201d5f5422fc • 5.8GB • 32K context window •
Text input • 11 months ago
qwen2.5-coder-7b-instruct-abliterated:q6_k_l
9d4dc85f442e • 6.5GB • 32K context window •
Text input • 11 months ago
qwen2.5-coder-7b-instruct-abliterated:q2_k
93df73dbfdba • 3.0GB • 32K context window •
Text input • 11 months ago
qwen2.5-coder-7b-instruct-abliterated:q3_k_s
7d0655ff9021 • 3.5GB • 32K context window •
Text input • 11 months ago
qwen2.5-coder-7b-instruct-abliterated:q3_k_m
7c3562063bab • 3.8GB • 32K context window •
Text input • 11 months ago
qwen2.5-coder-7b-instruct-abliterated:q3_k_l
c501224721e5 • 4.1GB • 32K context window •
Text input • 11 months ago
qwen2.5-coder-7b-instruct-abliterated:q4_0
750b1e74bf7c • 4.4GB • 32K context window •
Text input • 11 months ago
qwen2.5-coder-7b-instruct-abliterated:q4_k_s
b9057033224a • 4.5GB • 32K context window •
Text input • 11 months ago
qwen2.5-coder-7b-instruct-abliterated:q4_k_m
54157071c712 • 4.7GB • 32K context window •
Text input • 11 months ago
qwen2.5-coder-7b-instruct-abliterated:q5_k_m
7f8f49b6c160 • 5.4GB • 32K context window •
Text input • 11 months ago
qwen2.5-coder-7b-instruct-abliterated:q6_k
eb40e978389e • 6.3GB • 32K context window •
Text input • 11 months ago
qwen2.5-coder-7b-instruct-abliterated:q8_0
d2d5d5bb870d • 8.1GB • 32K context window •
Text input • 11 months ago
qwen2.5-coder-7b-instruct-abliterated:iq2_m
edbfe45b9c57 • 2.8GB • 32K context window •
Text input • 11 months ago
qwen2.5-coder-7b-instruct-abliterated:iq3_xs
e204da296583 • 3.3GB • 32K context window •
Text input • 11 months ago
qwen2.5-coder-7b-instruct-abliterated:iq4_xs
2c94ef505779 • 4.2GB • 32K context window •
Text input • 11 months ago