akuldatta/deepseek-coder-v2-lite:iq4xs

akuldatta/deepseek-coder-v2-lite

82 Pulls Updated 4 months ago

Updated 5 months ago

5 months ago

1fd1940effe9 · 8.6GB

parameters15.7B

quantizationIQ1_M

{{ if .System }}System: {{ .System }} {{ end }}{{ if .Prompt }}User: {{ .Prompt }} {{ end }}Assist

Readme

Models: DeepSeek Coder V2 Instruct Lite Quantized with IQ4_XS (https://ollama.com/akuldatta/deepseek-coder-v2-lite) and Q5_K_S (https://ollama.com/akuldatta/deepseek-coder-v2-lite:q5ks) quants.