batiai/ qwen3.5-9b:q6

225 2 days ago

Qwen 3.5 9B quantized by BatiAI. 12.5 t/s on 16GB Mac. Best for tool calling.

tools thinking
... /
params
9371364b27a5 · 65B
{
"presence_penalty": 1.5,
"temperature": 1,
"top_k": 20,
"top_p": 0.95
}