navthings/ lilchat:q4_k_m

7 3 weeks ago

lilbase (297m, trained from scratch) finetuned for chat on smol-smoltalk.

... /
params
4adee1613c31 ยท 103B
{
"num_ctx": 1024,
"num_predict": 400,
"repeat_penalty": 1.1,
"stop": [
"[INST]"
],
"temperature": 0.4,
"top_k": 40
}