jcdickinson/
wizardcoder:15b-q4_k_m

6,753 2 years ago

WizardCoder-15B - A programming model supporting more than Python

15b

2 years ago

0bee499a4490 · 10.0GB ·

model
starcoder
·
15.8B
·
Q4_K_M
template
{{- if .First }} ### System: {{ .System }} {{- end }} Below is an instruction that describes a task.
license
bigscience-openrail-m
params
{ "num_ctx": 2048, "num_predict": 200, "temperature": 0.2 }

Readme

This is an import of this model: https://huggingface.co/WizardLM/WizardCoder-15B-V1.0

It is a general-purpose WizardCoder model, supporting more than Python.

Tags

  • :latest, 15b, :15b-q4_0 - a q4_0 quantized version of the model (8569MB RAM).
  • :15b-q4_k_m - a q4_K_M quantized version of the model (9499MB RAM).
  • :15b-q5_k_m - a q5_K_M quantized version of the model (11000MB RAM).

I recommend the K_M models, depending on how much RAM you have available. The defaults merely match ollama defaults.

https://github.com/jcdickinson/