dagbs/ deepseek-coder-v2-lite-instruct

6,524 2 years ago

https://huggingface.co/bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF

22 models

deepseek-coder-v2-lite-instruct:latest
a6f5c73087ad • 10GB • 160K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:iq3_m
85d703efd04a • 7.6GB • 4K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:q4_k_l
c62fac0b3e3e • 11GB • 4K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:q5_k_l
3f2be9437fe5 • 12GB • 4K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:q6_k_l
8c2c53142849 • 15GB • 4K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:q8_0_l
81dde5304432 • 17GB • 4K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:q2_k
b35baba7b6f6 • 6.4GB • 4K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:q3_k_s
7fcd701d1a57 • 7.5GB • 4K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:q3_k_m
c0965f444534 • 8.1GB • 4K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:q3_k_l
615b0f22a704 • 8.5GB • 4K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:q4_k_s
d0cd485dbae5 • 9.5GB • 4K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:q4_k_m
a6f5c73087ad • 10GB • 160K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:q5_k_s
e886862e0209 • 11GB • 4K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:q5_k_m
9de2e5dfa08c • 12GB • 4K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:q6_k
7037b7401232 • 14GB • 160K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:q8_0
bf830c448371 • 17GB • 4K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:iq2_xs
0e0a79a3b38a • 6.0GB • 4K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:iq2_s
8018d103fac8 • 6.0GB • 4K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:iq2_m
f95b90c5abea • 6.3GB • 4K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:iq3_xxs
4722871eb238 • 7.0GB • 4K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:iq3_xs
2e98b5823add • 7.1GB • 4K context window •
Text input • 2 years ago
deepseek-coder-v2-lite-instruct:iq4_xs
5f0c4fedd8b8 • 8.6GB • 160K context window •
Text input • 2 years ago