33 5 days ago

Tiny 152M LLM with chat, step-by-step thinking, tools/web and honest code answers runs on almost anything.

tools thinking
32cc4643146e · 193B
{
"num_ctx": 512,
"num_predict": 320,
"repeat_penalty": 1.3,
"stop": [
"<|user|>",
"<|assistant|>",
"<|end|>",
"</|end|>"
],
"temperature": 0.3,
"top_k": 20,
"top_p": 0.9
}