102 Downloads Updated 2 days ago
ollama run decadence/ornith-1.5:9b-code-abliterated-mlx-4bit
Updated 2 days ago
2 days ago
2a6bf068cf56 · 5.1GB
| model | type | quant | unc | size | source |
|---|---|---|---|---|---|
| ornith-1.5:9b-base-abliterated-mlx-4bit | MLX | int4 | ✓ | 5.1 GB | ressl |
| ornith-1.5:9b-base-abliterated-mlx-8bit | MLX | int8 | ✓ | 9.5 GB | ressl |
| ornith-1.5:9b-base-mlx-4bit | MLX | int4 | - | 5.1 GB | ornith-ai |
| ornith-1.5:9b-base-mlx-8bit | MLX | int8 | - | 9.5 GB | ornith-ai |
| ornith-1.5:9b-base-q4_k_m | GGUF | Q4_K_M | - | 6.7 GB | ornith-ai |
| ornith-1.5:9b-base-q8_0 | GGUF | Q8_0 | - | 10 GB | ornith-ai |
| ornith-1.5:9b-code-abliterated-mlx-4bit | MLX | int4 | ✓ | 5.1 GB | ressl |
| ornith-1.5:9b-code-abliterated-mlx-8bit | MLX | int8 | ✓ | 9.5 GB | ressl |
| ornith-1.5:9b-code-mlx-4bit | MLX | int4 | - | 5.1 GB | ornith-ai |
| ornith-1.5:9b-code-mlx-8bit | MLX | int8 | - | 9.5 GB | ornith-ai |
| ornith-1.5:9b-code-q4_k_m | GGUF | Q4_K_M | - | 6.7 GB | ornith-ai |
| ornith-1.5:9b-code-q8_0 | GGUF | Q8_0 | - | 10 GB | ornith-ai |
Following Ornith-1.5-9B Recommended sampling parameters:
| parameter | base | code |
|---|---|---|
| temperature | 1.0 | 0.6 |
| top_p | 0.95 | 0.95 |
| top_k | 20 | 20 |
| min_p | 0.0 | 0.0 |
| presence_penalty | 1.5 | 0.0 |
| repetition_penalty | 1.0 | 1.0 |
MLX version of Ornith-1.5-9B is stripped of vision. Non-MLX version has vision capability.