Alieno/ ailo-152m-v2:q8_0

40 4 days ago

A 152M-parameter language model that runs on almost anything laptops, old PCs, even a Raspberry Pi yet does instruction-following chat, step-by-step reasoning, and web search for fresh facts.

tools thinking 152m
... /
params
3a2ace961965 · 193B
{
"num_ctx": 512,
"num_predict": 256,
"repeat_penalty": 1.3,
"stop": [
"<|end|>",
"</|end|>",
"<|user|>",
"<|assistant|>"
],
"temperature": 0.3,
"top_k": 20,
"top_p": 0.9
}