Thox-ai/ thoxmini-3b:Q4_K_M

22 1 month ago

THOX.ai lightweight edge assistant. Llama-3.2-3B QLoRA fine-tune, Q4_K_M, sized for Milk-V Duo / Pi-class hardware.

... /
template
64aa2a6e4a98 · 236B
{{ if .System }}<|begin_of_text|><|start_header_id|>system<|end_header_id|>
{{ .System }}<|eot_id|>{{ end }}<|start_header_id|>user<|end_header_id|>
{{ .Prompt }}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
{{ .Response }}