Mistral Small 3.1
17.8K Pulls 7 Tags Updated 1 year ago
165 Pulls 4 Tags Updated 1 year ago
Mistral-Small-3.1-24B-Instruct-2503 is a quantized GGUF variant of Mistral-small 3.1 24B Instruct (2503), optimized to run smoothly on GPUs with as low as 16GB VRAM.
1,729 Pulls 5 Tags Updated 1 year ago
Mistral Small 3.1 24B quantization from bartowski Q6_K with tool support
1,074 Pulls 1 Tag Updated 1 year ago
Q6_K / Q5_K_M / Q4_K_S | mistral-small3.1:24b-instruct-2503
617 Pulls 3 Tags Updated 1 year ago
Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M
329 Pulls 1 Tag Updated 1 year ago
Base model
27 Pulls 3 Tags Updated 1 year ago
128k context; no vision yet; Q8, Q6_K
435 Pulls 2 Tags Updated 1 year ago