trollek/
ninjamouse2:34l-q4_K_M

51 1 year ago

A tiny language model based on h2o-danube2-1.8b-chat. Block expanded.

... /
params
a609cba07be8 · 174B
{
"num_ctx": 8192,
"num_predict": 2048,
"repeat_penalty": 1.15,
"stop": [
"</s>",
"<|im_end|>",
"<|im_start|>"
],
"temperature": 0.65,
"top_k": 45,
"top_p": 0.9
}