252 1 month ago

128k context length for coding and other long-form questions

tools 30b
d4926f79160a · 136B
{
"num_ctx": 131072,
"repeat_penalty": 1,
"stop": [
"<|im_start|>",
"<|im_end|>"
],
"temperature": 0.7,
"top_k": 20,
"top_p": 0.8
}