JXW67/ TGAI_NB:0.86b

21 1 week ago

TGAI NB — a lightweight Chinese MoE chat model family, built end-to-end by a high school student. V2 (3B): 8-expert sparse MoE, better quality for desktop. V1 (0.86B): 4-expert sparse MoE, ultra-light, smooth on low-end devices.

0.86b 3b
... /
params
a15fa745eff4 · 177B
{
"num_ctx": 512,
"num_predict": 256,
"repeat_penalty": 1.3,
"stop": [
"用户:",
"TGAI?",
"TGA?",
"<0x",
"<EOS>",
"<BOS>"
],
"temperature": 0.3,
"top_k": 40,
"top_p": 0.9
}