freerainboxbox/
mistral-small

761 9 months ago

Alternative quantization levels, no fine-tuning

tools

11 models

mistral-small:24b-instruct-2501-q3_K_S
5193920bcf7d • 10GB • 32K context window •
Text input • 9 months ago
mistral-small:24b-instruct-2501-q3_K_M
91db04b7c3b7 • 11GB • 32K context window •
Text input • 9 months ago
mistral-small:24b-instruct-2501-q3_K_L
15831465e92f • 12GB • 32K context window •
Text input • 9 months ago
mistral-small:24b-instruct-2501-q4_0
57890cd99750 • 13GB • 32K context window •
Text input • 9 months ago
mistral-small:24b-instruct-2501-q4_1
537af93c11da • 15GB • 32K context window •
Text input • 9 months ago
mistral-small:24b-instruct-2501-q4_K_S
d0b46822b403 • 14GB • 32K context window •
Text input • 9 months ago
mistral-small:24b-instruct-2501-q5_0
2d090c9cb093 • 16GB • 32K context window •
Text input • 9 months ago
mistral-small:24b-instruct-2501-q5_1
03af312cde97 • 18GB • 32K context window •
Text input • 9 months ago
mistral-small:24b-instruct-2501-q5_K_S
dbbc056c06a2 • 16GB • 32K context window •
Text input • 9 months ago
mistral-small:24b-instruct-2501-q5_K_M
f83db8da35e2 • 17GB • 32K context window •
Text input • 9 months ago
mistral-small:24b-instruct-2501-q6_K
0efe219857af • 19GB • 32K context window •
Text input • 9 months ago