secfa/
DeepSeek-R1-UD-IQ1_M

4,296 7 months ago

Unsloth's DeepSeek-R1 , I just merged the thing and uploaded it here. This is the full 671b model. MoE Bits:1.73bit Type:UD-IQ1_M Disk Size:158GB Accuracy:Good Details:MoE all 1.56bit. down_proj in MoE left at 2.06bit

Models

View all →

2 models

DeepSeek-R1-UD-IQ1_M:latest

169GB · 4K context window · Text · 7 months ago

DeepSeek-R1-UD-IQ1_M:24g

169GB · 4K context window · Text · 7 months ago

Readme

tag latest ：The graphics card is not supported for both ollama and screen display at the same time

tag 24g for 24g vRAM: 19g model + 1.8g fp16 kv cache + windows system reserve