22 Downloads Updated 5 hours ago
ollama run turintech/qwen3.5-2b-artemis
Updated 5 hours ago
5 hours ago
f4680b970783 · 1.4GB
Text-only GGUF versions of Qwen3.5 2B. The vision encoder and multi-token prediction (MTP) layer are not included.
TurinTech models, built with Artemis
ollama run turintech/qwen3.5-2b-artemis:q5_k_m
latest selects q5_k_m. The explicit tags below use the same model bytes as the corresponding Hugging Face files.
| Tag | Hugging Face file | Size |
|---|---|---|
q5_k_m (default) |
Qwen3.5-2B-Artemis-Q5_K_M.gguf |
1.395 GB |
q4_k_m |
Qwen3.5-2B-Artemis-Q4_K_M.gguf |
1.280 GB |
GB is download size, not runtime memory. Packages use Ollama’s Qwen3.5 renderer and tool parser, with temperature 1, top_k 20, top_p 0.95 and presence_penalty 1.5. The comparison benchmarks used llama.cpp with different sampling settings; these packages do not establish the same benchmark results in Ollama.
In the RTX 5090 HumanEval+ check, Q5_K_M passed 73⁄164 tasks and Q4_K_M 70⁄164, versus 81⁄164 for BF16. Unsloth Q4_K_M also scored higher on the earlier MMLU-Pro sample. The selected CodeSearchNet calibration functions still need a per-repository licence inventory; no calibration source text is included.
Full measurements and test conditions.
Apache-2.0, as released by Qwen (licence). See LICENSE and NOTICE. This is an independent TurinTech conversion, not affiliated with or endorsed by Alibaba Cloud or the Qwen team.
These files keep improving.