livchart/ mistral-nemo-12b-q6:latest

40 5 months ago

LivChart-Optimized Analytics Model

... /
params
1c29b66a4331 ยท 125B
{
"num_ctx": 8192,
"num_gpu": 40,
"num_predict": 2048,
"repeat_penalty": 1.05,
"stop": [
"</s>"
],
"temperature": 0,
"top_p": 0.1
}