114 1 week ago

Qwen3.5-35B-A3B-Base quantized to fit in 16GB GPU RAM

vision tools thinking
4e83d6425eb4 · 205B
{
"num_ctx": 32768,
"num_predict": 4096,
"presence_penalty": 1.3,
"repeat_penalty": 1.1,
"stop": [
"<|im_start|>",
"<|im_end|>",
"<|endoftext|>"
],
"temperature": 0.6,
"top_k": 20,
"top_p": 0.8
}