Codestral model with an optimised system prompt and parameters specifically for coding.

282 5 months ago

606605438e1f · 207B
{
"frequency_penalty": 0.2,
"num_batch": 1024,
"num_ctx": 18432,
"num_keep": 384,
"presence_penalty": 0.2,
"repeat_last_n": 50,
"stop": [
"[INST]",
"[/INST]",
"[PREFIX]",
"[MIDDLE]",
"[SUFFIX]"
],
"temperature": 0.4,
"top_p": 0.9
}