sammcj/
qwen2.5-coder-32b-128k

420 8 months ago

Qwen2.5 Coder 32B with the corrected 128k context

tools

Models

View all →

1 model

qwen2.5-coder-32b-128k:q6_k

27GB · 128K context window · Text · 8 months ago

Readme

This uses Unsloth’s GGUF which fixes the context length (the official Ollama model is wrong).

https://huggingface.co/unsloth/Qwen2.5-Coder-32B-Instruct-128K-GGUF/blob/main/Qwen2.5-Coder-32B-Instruct-Q6_K.gguf