jcdickinson / wizardcoder

WizardCoder-15B - A programming model supporting more than Python

15B

151 Pulls Updated 11 months ago

11 months ago

710b49cfc97b · 9.0GB

model
starcoder
·
15.8B
·
Q4_0
template
{{- if .First }} ### System: {{ .System }} {{- end }} Below is an instruction that describes a task. Write a response that appropriately completes the request. ### Instruction: {{ .Prompt }} ### Response:
license
bigscience-openrail-m
params
{"num_ctx":2048,"num_predict":200,"temperature":0.2}

Readme

This is an import of this model: https://huggingface.co/WizardLM/WizardCoder-15B-V1.0

It is a general-purpose WizardCoder model, supporting more than Python.

Tags

  • :latest, 15b, :15b-q4_0 - a q4_0 quantized version of the model (8569MB RAM).
  • :15b-q4_k_m - a q4_K_M quantized version of the model (9499MB RAM).
  • :15b-q5_k_m - a q5_K_M quantized version of the model (11000MB RAM).

I recommend the K_M models, depending on how much RAM you have available. The defaults merely match ollama defaults.

https://github.com/jcdickinson/