Supa-AI/
ministral-8b-instruct-2410

402 1 year ago

Quantized versions of the new ministral 8B! This is purely for research purposes and not for commercial distribution

13 models

ministral-8b-instruct-2410:q3_k_s
bf9c762e54ec • 3.7GB • 32K context window •
Text input • 1 year ago
ministral-8b-instruct-2410:q3_k_m
048c5e3e9893 • 4.0GB • 32K context window •
Text input • 1 year ago
ministral-8b-instruct-2410:q3_k_l
ba32e06b310b • 4.3GB • 32K context window •
Text input • 1 year ago
ministral-8b-instruct-2410:q4_0
53dd4ecde0c5 • 4.7GB • 32K context window •
Text input • 1 year ago
ministral-8b-instruct-2410:q4_1
39582996a3c2 • 5.1GB • 32K context window •
Text input • 1 year ago
ministral-8b-instruct-2410:q4_k_s
069ba5f16c89 • 4.7GB • 32K context window •
Text input • 1 year ago
ministral-8b-instruct-2410:q4_k_m
47bdbc377242 • 4.9GB • 32K context window •
Text input • 1 year ago
ministral-8b-instruct-2410:q5_0
1d00620792a2 • 5.6GB • 32K context window •
Text input • 1 year ago
ministral-8b-instruct-2410:q5_1
ee955b8bdfbe • 6.1GB • 32K context window •
Text input • 1 year ago
ministral-8b-instruct-2410:q5_k_s
8a725488d86a • 5.6GB • 32K context window •
Text input • 1 year ago
ministral-8b-instruct-2410:q5_k_m
0a3ad47f3c12 • 5.7GB • 32K context window •
Text input • 1 year ago
ministral-8b-instruct-2410:q6_k
17a01c285976 • 6.6GB • 32K context window •
Text input • 1 year ago
ministral-8b-instruct-2410:q8_0
b5ecd48aefe7 • 8.5GB • 32K context window •
Text input • 1 year ago