22 2 months ago

General purpose chatting model in 0.2b, super dumb but lightweight.

0e00ac60a338 · 126B
{
"num_ctx": 1024,
"repeat_penalty": 1.45,
"stop": [
"[/INST]",
"</s>",
"\\n\\n"
],
"temperature": 0.6,
"top_k": 30,
"top_p": 0.85
}