Merged Unsloth's Dynamic Quantization
1,382 Pulls 1 Tag Updated 1 year ago
deepseek-v3-0324-Quants. - Q2_K is the lowest here - quantized = round((original - zero_point) / scale)
1,128 Pulls 1 Tag Updated 1 year ago
DeepSeep V3 from March 2025 Merged from Unsloth's HF - 671B params - Q8_0/713 GB & Q4_K_M/404 GB
958 Pulls 4 Tags Updated 1 year ago
dynamic quants from unsloth, merged
294 Pulls 1 Tag Updated 1 year ago
Latest DeepSeek_V3 model Q4
249 Pulls 1 Tag Updated 1 year ago
This model has been developed based on DistilQwen2.5-DS3-0324-Series.
1,220 Pulls 7 Tags Updated 1 year ago