michaelmontuori/ Qwen3.5-4B-GGUF:UD-Q4_K_XL-128k

31 3 days ago

Built this model to fit RTX 5070 with 12GB of VRAM

vision
ollama run michaelmontuori/Qwen3.5-4B-GGUF:UD-Q4_K_XL-128k

Details

3 days ago

cfdc2614b736 · 3.6GB

qwen35
·
4.21B
·
Q4_K_M
clip
·
334M
·
BF16
{ "num_ctx": 131070 }

Readme

This model works well on RTX 5070 with 12GB of VRAM