Thox-ai/ thoxroute:latest

46 2 weeks ago

THOX preference- and intent-routing model: a rank-16 LoRA on Qwen2.5-1.5B-Instruct that classifies requests so the stack routes them to the right model or tool. ~0.99 GB Q4_K_M GGUF. THOX-trained adapter. Apache-2.0.

tools 1.5b
... /
params
2c550a17c562 ยท 119B
{
"num_ctx": 8192,
"num_predict": 12,
"stop": [
"<|im_start|>",
"<|im_end|>"
],
"temperature": 0,
"top_p": 0.9
}