Thox-ai/ thoxmini-3b:Q4_K_M

22 1 month ago

THOX.ai lightweight edge assistant. Llama-3.2-3B QLoRA fine-tune, Q4_K_M, sized for Milk-V Duo / Pi-class hardware.

... /
params
80741fc40e0a · 108B
{
"num_ctx": 8192,
"stop": [
"<|eot_id|>",
"<|end_of_text|>"
],
"temperature": 0.7,
"top_p": 0.95
}