8 3 days ago

1b size model running quillan system settings and custom paramater tuning

thinking
662ab0a2d52a ยท 188B
{
"num_ctx": 2097152,
"repeat_penalty": 1.15,
"stop": [
"<|system|>",
"<|user|>",
"<|assistant|>",
"<|endoftext|>"
],
"temperature": 0.3,
"top_k": 40,
"top_p": 0.9
}