Models
GitHub
Discord
Docs
Cloud
Sign in
Download
Models
Download
GitHub
Discord
Docs
Cloud
Sign in
pielee
/
qwen3-4b_q8
:latest
141
Downloads
Updated
3 months ago
A 4B-parameter, 8-bit quantized inference model with /think (reasoning) and /no_think (fast response) modes.
A 4B-parameter, 8-bit quantized inference model with /think (reasoning) and /no_think (fast response) modes.
Cancel
tools
thinking
qwen3-4b_q8:latest
...
/
params
cff3f395ef37 · 120B
{
"repeat_penalty": 1,
"stop": [
"<|im_start|>",
"<|im_end|>"
],
"temperature": 0.6,
"top_k": 20,
"top_p": 0.95
}