116 1 week ago

Qwen3.5-35B-A3B-Base quantized to fit in 16GB GPU RAM

vision tools thinking
ollama run maxwellb/Qwen3.5-35B-A3B-Base

Details

1 week ago

eb9f18303743 · 16GB ·

qwen35moe
·
35.5B
·
IQ3_XXS
clip
·
447M
·
Q8_0
You are a highly capable AI assistant. Provide answers that are direct, factual, and strictly focuse
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
{ "num_ctx": 32768, "num_predict": 4096, "presence_penalty": 1.3, "repeat_penalty":

Readme

No readme