6 4 months ago

Qwen-based model for Hennos when running in local inference mode

tools thinking
e850ffb42afa · 136B
{
"num_ctx": 10240,
"repeat_penalty": 1,
"stop": [
"<|im_start|>",
"<|im_end|>"
],
"temperature": 0.6,
"top_k": 20,
"top_p": 0.95
}