8b-wraith/
deepseek-v3-0324

975 6 months ago

deepseek-v3-0324-Quants. - Q2_K is the lowest here - quantized = round((original - zero_point) / scale)

1 model

deepseek-v3-0324:latest
9ab4d2405e80 • 289GB • 4K context window •
Text input • 6 months ago