deepseek-v3-0324-Quants. - Q2_K is the lowest here - quantized = round((original - zero_point) / scale)
956 Pulls 1 Tag Updated 5 months ago