trollek/
ninjamouse2:34l-v02-q6_K

51 1 year ago

A tiny language model based on h2o-danube2-1.8b-chat. Block expanded.

... /
params
e0e32964ff63 · 172B
{
"num_ctx": 8192,
"num_predict": 2048,
"repeat_penalty": 1.15,
"stop": [
"</s>",
"<|prompt|>",
"<|answer|>"
],
"temperature": 0.55,
"top_k": 45,
"top_p": 0.9
}