mannix/
qwen2.5-coder

793 8 months ago

The latest series of Code-Specific Qwen models, with significant improvements in code generation, code reasoning, and code fixing. I-Quant models.

tools

Models

View all →

47 models

qwen2.5-coder:latest

4.4GB · 32K context window · Text · 8 months ago

Readme

Qwen 2.5 Coder series of models are now updated in 6 sizes: 0.5B, 1.5B, 3B, 7B, 14B and 32B.

  • Quantization from fp32
  • Using i-matrix calibration dataset calibration_datav3.txt
  • I-Quants models, only if passing tests iq2_xs, iq2_xxs, iq3_xxs, iq4_nl, iq3_s, iq2_s, iq4_xs, iq3_xs
  • Default quantization 7b:iq4_nl

Model description

image.png