trollek/
ninjamouse2:34l-v02-q4_K_S

51 1 year ago

A tiny language model based on h2o-danube2-1.8b-chat. Block expanded.

... /
params
a1098674e69b · 171B
{
"num_ctx": 8192,
"num_predict": 2048,
"repeat_penalty": 1.1,
"stop": [
"</s>",
"<|prompt|>",
"<|answer|>"
],
"temperature": 0.5,
"top_k": 45,
"top_p": 0.95
}