Codestral model with an optimised system prompt and parameters specifically for coding.
282 Pulls Updated 5 months ago
Updated 5 months ago
5 months ago
3ce92869905d · 18GB
model
archllama
·
parameters22.2B
·
quantizationQ6_K
18GB
template
[INST] {{ if .System }}
<<SYS>>{{ .System }}<</SYS>>{{ end }}
{{ .Prompt }} [/INST] {{ .Response }}
99B
params
{"frequency_penalty":0.2,"num_batch":1024,"num_ctx":16384,"num_keep":8,"presence_penalty":0.2,"repea
205B
system
You are an expert software engineer proficient in multiple programming languages. Your task is to g
687B
Readme
Codestral model with an optimised system prompt and parameters specifically for coding.
This is not a fine-tune, the model is from https://huggingface.co/MaziyarPanahi/Codestral-22B-v0.1-GGUF
You may need to adjust the num_batch and num_ctx to be suited for your available VRAM.