Codestral model with an optimised system prompt and parameters specifically for coding.
282 Pulls Updated 5 months ago
Updated 5 months ago
5 months ago
eb8438a74824 · 16GB
model
archllama
·
parameters22.2B
·
quantizationQ5_K_M
16GB
template
[INST] {{ if .System }}
<<SYS>>{{ .System }}<</SYS>>{{ end }}
{{ .Prompt }} [/INST] {{ .Response }}
99B
params
{"frequency_penalty":0.2,"num_batch":1024,"num_ctx":18432,"num_keep":384,"presence_penalty":0.2,"rep
207B
system
You are an expert software engineer proficient in multiple programming languages. Your task is to g
1.3kB
Readme
Codestral model with an optimised system prompt and parameters specifically for coding.
This is not a fine-tune, the model is from https://huggingface.co/MaziyarPanahi/Codestral-22B-v0.1-GGUF
You may need to adjust the num_batch and num_ctx to be suited for your available VRAM.