sharky172/ qwen3.6:27b-mtp-q4_K_M-512k

851 2 weeks ago

Qwen 3.6, MTP-enabled, 512k context (20GB KV cache footprint with OLLAMA_KV_CACHE_TYPE=q8_0)

ollama run sharky172/qwen3.6:27b-mtp-q4_K_M-512k

Details

2 weeks ago

05d234b1b1a9 · 17GB ·

qwen35
·
27.3B
·
Q4_K_M
{ "num_ctx": 524288 }

Readme

No readme