secfa/DeepSeek-R1-UD-Q2_K

secfa/

DeepSeek-R1-UD-Q2_K_XL:24g

2,029 Downloads Updated 7 months ago

Unsloth's DeepSeek-R1 , I just merged the thing and uploaded it here. This is the full 671b model. MoE Bits:2.51bit Type:UD-Q2_K_XL Disk Size:212GB Accuracy:Best Details:MoE all 2.5bit. down_proj in MoE mixture of 3.5/2.5bit

Updated 7 months ago

7 months ago

9dee85e0fe5f · 227GB

archdeepseek2

parameters671B

quantizationQ2_K

227GB

{{- if .System }}{{ .System }}{{ end }} {{- range $i, $_ := .Messages }} {{- $last := eq (len (slice

394B

{ "num_gpu": 11, "stop": [ "<｜begin▁of▁sentence｜>", "<｜end▁of▁

161B

tag latest ：The graphics card is not supported for both ollama and screen display at the same time

tag 24g for 24g vRAM: 21g model + 1.8g fp16 kv cache + windows system reserve