-
DeepSeek-R1-UD-IQ1_S
Unsloth's DeepSeek-R1 , I just merged the thing and uploaded it here. This is the full 671b model. MoE Bits:1.58bit Type:UD-IQ1_S Disk Size:131GB Accuracy:Fair Details:MoE all 1.56bit. down_proj in MoE mixture of 2.06/1.56bit
171K Pulls 2 Tags Updated 1 year ago
-
DeepSeek-R1-UD-IQ1_M
Unsloth's DeepSeek-R1 , I just merged the thing and uploaded it here. This is the full 671b model. MoE Bits:1.73bit Type:UD-IQ1_M Disk Size:158GB Accuracy:Good Details:MoE all 1.56bit. down_proj in MoE left at 2.06bit
4,354 Pulls 2 Tags Updated 1 year ago
-
DeepSeek-R1-UD-Q2_K_XL
Unsloth's DeepSeek-R1 , I just merged the thing and uploaded it here. This is the full 671b model. MoE Bits:2.51bit Type:UD-Q2_K_XL Disk Size:212GB Accuracy:Best Details:MoE all 2.5bit. down_proj in MoE mixture of 3.5/2.5bit
2,074 Pulls 2 Tags Updated 1 year ago
-
DeepSeek-R1-UD-IQ2_XXS
Unsloth's DeepSeek-R1 , I just merged the thing and uploaded it here. This is the full 671b model. MoE Bits:2.22bit Type:UD-IQ2_XXS Disk Size:183GB Accuracy:Better Details:MoE all 2.06bit. down_proj in MoE mixture of 2.5/2.06bit
1,407 Pulls 2 Tags Updated 1 year ago