6 1 year ago

Mini Ace model no thinking trace in this version

tools
a9e0129c3c00 ยท 209B
{
"num_batch": 1024,
"num_ctx": 4096,
"num_predict": 2048,
"repeat_penalty": 1.1,
"stop": [
"<|start_header_id|>",
"<|end_header_id|>",
"<|eot_id|>"
],
"temperature": 0.7,
"top_k": 50,
"top_p": 0.9
}