30 5 hours ago

Text-only Qwen3.5 9B GGUF files. Default: q4_k_m. TurinTech models, built with Artemis.

tools thinking
ollama run turintech/qwen3.5-9b-artemis

Details

5 hours ago

7e499ea366f4 · 5.7GB

qwen35
·
8.95B
·
Q4_K_M
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
{ "presence_penalty": 1.5, "temperature": 1, "top_k": 20, "top_p": 0.95 }

Readme

Qwen3.5 9B Artemis

Text-only GGUF versions of Qwen3.5 9B. The vision encoder and multi-token prediction (MTP) layer are not included.

TurinTech models, built with Artemis

Ollama

ollama run turintech/qwen3.5-9b-artemis:q4_k_m

latest selects q4_k_m. The explicit tags below use the same model bytes as the corresponding Hugging Face files.

Tag Hugging Face file Size
iq4_xs Qwen3.5-9B-Artemis-IQ4_XS.gguf 5.167 GB
q4_k_m (default) Qwen3.5-9B-Artemis-Q4_K_M.gguf 5.661 GB
q5_k_s Qwen3.5-9B-Artemis-Q5_K_S.gguf 6.155 GB

GB is download size, not runtime memory. Packages use Ollama’s Qwen3.5 renderer and tool parser, with temperature 1, top_k 20, top_p 0.95 and presence_penalty 1.5. The comparison benchmarks used llama.cpp with different sampling settings; these packages do not establish the same benchmark results in Ollama.

Measurements and limitations

The default Q4_K_M has lower KL but worse WikiText perplexity than Unsloth Q4_K_M in the current-file replay (PPL ratios to BF16: 1.012493 versus 1.005114). IQ4_XS has direct fidelity measurements, but its historical task scores cannot be linked to the downloadable file and are omitted.

Full measurements and test conditions.

Licence

Apache-2.0, as released by Qwen (licence). See LICENSE and NOTICE. This is an independent TurinTech conversion, not affiliated with or endorsed by Alibaba Cloud or the Qwen team.

These files keep improving.