MichelRosselli/ ternary-bonsai:latest

27 4 days ago

Ternary Bonsai: 1.58-bit Language Models at 8B, 4B, and 1.7B Scale.

tools thinking
... /
params
c5a83f31d755 · 146B
{
"min_p": 0,
"num_ctx": 65536,
"repeat_penalty": 1,
"stop": [
"<|im_start|>",
"<|im_end|>"
],
"temperature": 0.5,
"top_k": 20,
"top_p": 0.85
}