13 2 months ago

This model is optimized for programming purposes. 7B parameters and based off codellama model.

92cdf361baf8 · 220B
{
"num_ctx": 4096,
"num_predict": 2048,
"repeat_penalty": 1.13,
"rope_frequency_base": 1000000,
"stop": [
"[INST]",
"[/INST]",
"<<SYS>>",
"<</SYS>>"
],
"temperature": 0.55,
"top_k": 40,
"top_p": 0.92
}