30 10 months ago

tools 3b
577ba471486e ยท 70B
{
"num_ctx": 8192,
"num_gpu": 999,
"repeat_penalty": 1.1,
"temperature": 0.6
}