212 2 weeks ago

Unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF with defaults to consume roughly 32 GB of VRAM

tools 30b
e004fb16a62b · 149B
{
"min_p": 0,
"num_ctx": 145408,
"repeat_penalty": 1.05,
"stop": [
"<|im_start|>",
"<|im_end|>"
],
"temperature": 0.7,
"top_k": 20,
"top_p": 0.8
}