16 models
Magistral is a small, efficient reasoning model with 24B parameters.
Generic all purpose model.
Mistral Small 3.1
Mistral-Small-3.1-24B-Instruct-2503 is a quantized GGUF variant of Mistral-small 3.1 24B Instruct (2503), optimized to run smoothly on GPUs with as low as 16GB VRAM.
Mistral Small 3.1 24B quantization from bartowski Q6_K with tool support
Q6_K / Q5_K_M / Q4_K_S | mistral-small3.1:24b-instruct-2503
fine-tuned version of mistralai/Mistral-Small-24B-Instruct-2501, optimized specifically for creative writing tasks. by **lars1234**
Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M
Base model
128k context; no vision yet; Q8, Q6_K
This is the Q4_K converted version of the original Qiskit/mistral-small-3.2-24b-qiskit provided by IBM's Qiskit Huggingface. Please refer to the original mistral-small-3.2-24b-qiskit model card for more details.