569 Downloads Updated 3 months ago
I鈥檝e uploaded the quants of these models that I find most useful. I quantized them myself using the fp16 GGUF files.
For 1.5b: Q5_K_M, Q8_0 (default), F16
For 3b: Q4_K_M (default), Q5_K_M, Q8_0, F16
The ultimate general-purpose local AI model, enabling coding, math, and more.
Created by the cognitivecomputations team.