Merged Unsloth's Dynamic Quantization
deepseek-v3-0324-Quants. - Q2_K is the lowest here - quantized = round((original - zero_point) / scale)
DeepSeep V3 from March 2025 Merged from Unsloth's HF - 671B params - Q8_0/713 GB & Q4_K_M/404 GB
dynamic quants from unsloth, merged
Latest DeepSeek_V3 model Q4
This model has been developed based on DistilQwen2.5-DS3-0324-Series.