9 2 days ago

iOS grounded chat model. THOX-configured Qwen2.5-3B, not THOX-trained. 11.32 tok/s long-form, 2.42 GB RAM on CPU at 8,192 ctx; grounding 6/8, trap declined. Qwen Research License (non-commercial).

tools
80327e62bf3a ยท 17B
{
"num_ctx": 2048
}