zendar79/ qwen3:4b-q4km

767 7 months ago

I've started from Qwen/Qwen3-4B-Instruct-2507 fp16 and quantised it

tools
... /
params
9297f08dd6c6 · 65B
{
"repeat_penalty": 1.05,
"temperature": 0.7,
"top_k": 20,
"top_p": 0.8
}