oamazonasgabriel/ qwen2.5-coder-0.5b

14 yesterday

A lightweight, FIM (Fill-In-the-Middle) optimized variant of Qwen2.5-Coder-0.5B-Instruct using the fp16 GGUF quantization from HuggingFace. At only ~1 GB, it fits comfortably on any 8 GB single GPU with headroom for 8K context.

1 model

qwen2.5-coder-0.5b:fp16-8gbGPU
d7e7d36470e2 • 1.3GB • 32K context window •
Text input • yesterday