37 Downloads Updated 1 week ago
Qwen3.5 9B in GGUF Q4_K_M, packaged by Interim Labs for local text generation.
ollama run sachasayan/interimlabs-qwen3.5-9b:q4_k_m
Models
View all →Readme
Interim Labs Qwen3.5-9B · GGUF Q4_K_M
A standalone GGUF Q4_K_M release published by Interim Labs for local text generation. This package derives from Qwen/Qwen3.5-9B. The GGUF weights are redistributed byte-for-byte from the credited conversion source below.
Model series
Part of the Interim Labs Qwen3.5 series: three sizes, each with an original Qwen3.5 variant and a Huihui abliterated variant, in two formats.
| Model | MLX 4-bit | GGUF Q4_K_M |
|---|---|---|
| Qwen3.5 2B | MLX | GGUF |
| Huihui Qwen3.5 2B abliterated | MLX | GGUF |
| Qwen3.5 4B | MLX | GGUF |
| Huihui Qwen3.5 4B abliterated | MLX | GGUF |
| Qwen3.5 9B | MLX | GGUF |
| Huihui Qwen3.5 9B abliterated | MLX | GGUF |
Package details
| Property | Value |
|---|---|
| Parameter class | 9B |
| Format | GGUF |
| Quantization | Q4_K_M |
| Weight file | model.gguf |
| Weight size | 5.63 GB (5,627,045,120 bytes) |
| GGUF architecture | qwen35 |
| Context in GGUF metadata | 262,144 tokens; practical limits depend on runtime and memory |
No tensors were rewritten in this release. The context value in the GGUF metadata is not a claim of tested long-context quality or of memory requirements.
Ollama
ollama run sachasayan/interimlabs-qwen3.5-9b:q4_k_m
Packaged by Interim Labs and distributed here through sachasayan. Default context is 8,192 tokens.
Usage and runtime requirements
Download the package with the Hugging Face CLI:
hf download interimlabs/InterimLabs-Qwen3.5-9B-GGUF-Q4_K_M model.gguf
Load model.gguf in a GGUF runtime with Qwen3.5 (qwen35) support, such as a compatible build of llama.cpp. Q4_K_M support alone is insufficient if the runtime does not support the model architecture. Choose context and GPU offload settings for your available memory. Compatibility across applications has not been comprehensively verified.
Sources and conversion
- GGUF source: mradermacher/Qwen3.5-9B-GGUF at
9345434ae3c14ecb7b5021df007518f70b2a5231. - Source weight file:
Qwen3.5-9B.Q4_K_M.gguf. - Reference upstream: Qwen/Qwen3.5-9B at
c202236235762e1c871ad0ccb60c8ee5ba337b9a.
The conversion source does not establish the exact upstream revision used for its conversion. The reference revision above documents the inspected upstream snapshot, not a verified conversion lineage.
See provenance.json for source and package metadata.
Weight-file SHA-256:
9fa52e37c8293ee02cf277634f8d3a392dc3239b8ccef2315b4c8c9ef223e7fb
Evaluation and limitations
This release does not include a comprehensive benchmark of the packaged model. No writing-quality, reliability, or performance improvement over the credited source is claimed.
License and credits
Distributed under Apache-2.0. Credit belongs to the Qwen team and the conversion authors linked above. Interim Labs publishes this package and its documentation. See the linked upstream cards for the original model details and limitations.