5 Downloads Updated yesterday
ollama run decadence/mellum2.1:12b-a2.5b-thinking-q6_k
| model | type | quant | size | source |
|---|---|---|---|---|
| mellum2.1:12b-a2.5b-thinking-q4_k_m | GGUF | Q4_K_M | 8.1 GB | JetBrains |
| mellum2.1:12b-a2.5b-thinking-q6_k | GGUF | Q6_K | 10 GB | JetBrains |
Following Mellum2.1 recommended sampling parameters:
| parameter | value |
|---|---|
| temperature | 0.6 |
| top_p | 0.95 |
| top_k | 20 |