2,523 1 year ago

https://huggingface.co/bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF

Models

View all →

22 models

deepseek-coder-v2-lite-instruct:latest

10GB · 4K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:iq3_m

7.6GB · 4K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:q4_k_l

11GB · 4K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:q5_k_l

12GB · 4K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:q6_k_l

15GB · 4K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:q8_0_l

17GB · 4K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:q2_k

6.4GB · 4K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:q3_k_s

7.5GB · 4K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:q3_k_m

8.1GB · 4K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:q3_k_l

8.5GB · 4K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:q4_k_s

9.5GB · 4K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:q4_k_m

10GB · 4K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:q5_k_s

11GB · 4K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:q5_k_m

12GB · 4K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:q6_k

14GB · 160K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:q8_0

17GB · 4K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:iq2_xs

6.0GB · 4K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:iq2_s

6.0GB · 4K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:iq2_m

6.3GB · 4K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:iq3_xxs

7.0GB · 4K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:iq3_xs

7.1GB · 4K context window · Text · 1 year ago

deepseek-coder-v2-lite-instruct:iq4_xs

8.6GB · 160K context window · Text · 1 year ago

Readme

No readme