2 4 days ago

six layer variant of quillan small 0.5b model

thinking
691306631f5b ยท 166B
{
"num_ctx": 2097152,
"repeat_penalty": 1.15,
"stop": [
"<|im_start|>",
"<|im_end|>",
"<|endoftext|>"
],
"temperature": 0.3,
"top_k": 40,
"top_p": 0.9
}