LESSTHANSUPER/ MAGNUM_V4-Mistral_Small

484 2 months ago

Suite of weighted quantizations for Magnum V4 models. Available in 9b, 12b, 22b, and 27b. Made by Anthracite-org (Huggingface).

tools

26 models

MAGNUM_V4-Mistral_Small:12b_IQ4_XS
4eacfa66273d • 6.7GB • 1000K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:12b_Q4_K_S
b4552852d9ff • 7.1GB • 1000K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:12b_Q5_K_M
5b9498beb8b4 • 8.7GB • 1000K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:12b_Q6_K
642cdc830eb3 • 10GB • 1000K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:22b_IQ4_XS
a6f7eef29057 • 12GB • 32K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:22b_Q4_K_M
fb22d9fff9fe • 13GB • 32K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:27b_IQ3_M
8080ea77b993 • 12GB • 8K context window •
Text input • 2 months ago
MAGNUM_V4-Mistral_Small:27b_IQ3_S
441ad7ab8043 • 12GB • 8K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:27b_IQ3_XS
98af6e99b22c • 12GB • 8K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:27b_IQ3_XXS
b922b1936a1d • 11GB • 8K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:27b_IQ4_XS
e1b7fcc59456 • 15GB • 8K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:27b_Q2_K
f4ce8518e89e • 10GB • 8K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:27b_Q3_K_L
0b6c43f228c2 • 15GB • 8K context window •
Text input • 2 months ago
MAGNUM_V4-Mistral_Small:27b_Q3_K_M
9dd9226f5de3 • 13GB • 8K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:27b_Q3_K_S
19167623d11e • 12GB • 8K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:27b_Q4_K_S
734d8610904f • 16GB • 8K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:27b_Q5_K_S
80302d397c77 • 19GB • 8K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:9b_IQ2_S
aa8327639362 • 3.2GB • 8K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:9b_IQ3_S
e1368bd68ef8 • 4.3GB • 8K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:9b_IQ3_XXS
ae85333c508a • 3.8GB • 8K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:9b_IQ4_XS
e8a2ac6e63a7 • 5.2GB • 8K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:9b_Q2_K
0f45a2c00211 • 3.8GB • 8K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:9b_Q3_K_L
becde6159298 • 5.1GB • 8K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:9b_Q4_K_S
ffc08fada271 • 5.5GB • 8K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:9b_Q5_K_M
20dd071a824f • 6.6GB • 8K context window •
Text input • 3 months ago
MAGNUM_V4-Mistral_Small:9b_Q6_K
fd6adf93f41d • 7.6GB • 8K context window •
Text input • 3 months ago