30 Downloads Updated 5 hours ago
ollama run turintech/qwen3.5-9b-artemis
Updated 5 hours ago
5 hours ago
7e499ea366f4 · 5.7GB
Text-only GGUF versions of Qwen3.5 9B. The vision encoder and multi-token prediction (MTP) layer are not included.
TurinTech models, built with Artemis
ollama run turintech/qwen3.5-9b-artemis:q4_k_m
latest selects q4_k_m. The explicit tags below use the same model bytes as the corresponding Hugging Face files.
| Tag | Hugging Face file | Size |
|---|---|---|
iq4_xs |
Qwen3.5-9B-Artemis-IQ4_XS.gguf |
5.167 GB |
q4_k_m (default) |
Qwen3.5-9B-Artemis-Q4_K_M.gguf |
5.661 GB |
q5_k_s |
Qwen3.5-9B-Artemis-Q5_K_S.gguf |
6.155 GB |
GB is download size, not runtime memory. Packages use Ollama’s Qwen3.5 renderer and tool parser, with temperature 1, top_k 20, top_p 0.95 and presence_penalty 1.5. The comparison benchmarks used llama.cpp with different sampling settings; these packages do not establish the same benchmark results in Ollama.
The default Q4_K_M has lower KL but worse WikiText perplexity than Unsloth Q4_K_M in the current-file replay (PPL ratios to BF16: 1.012493 versus 1.005114). IQ4_XS has direct fidelity measurements, but its historical task scores cannot be linked to the downloadable file and are omitted.
Full measurements and test conditions.
Apache-2.0, as released by Qwen (licence). See LICENSE and NOTICE. This is an independent TurinTech conversion, not affiliated with or endorsed by Alibaba Cloud or the Qwen team.
These files keep improving.