mattw/ amazon_mistrallite

54 2 years ago

14 models

amazon_mistrallite:q2_K
2c7f91ce818f • 3.1GB • 32K context window •
Text input • 2 years ago
amazon_mistrallite:q3_K_S
3b2e080582b2 • 3.2GB • 32K context window •
Text input • 2 years ago
amazon_mistrallite:q3_K_M
18e24d1a9a7d • 3.5GB • 32K context window •
Text input • 2 years ago
amazon_mistrallite:q3_K_L
7cc6eff233e5 • 3.8GB • 32K context window •
Text input • 2 years ago
amazon_mistrallite:q4_1
f9b3c152bc7f • 4.6GB • 32K context window •
Text input • 2 years ago
amazon_mistrallite:q4_K_S
0544375ad511 • 4.1GB • 32K context window •
Text input • 2 years ago
amazon_mistrallite:q4_K_M
70ac2e888500 • 4.4GB • 32K context window •
Text input • 2 years ago
amazon_mistrallite:q5_0
308b28bda77b • 5.0GB • 32K context window •
Text input • 2 years ago
amazon_mistrallite:q5_1
98ff0b1982a0 • 5.4GB • 32K context window •
Text input • 2 years ago
amazon_mistrallite:q5_K_S
6b6eedbfc93a • 5.0GB • 32K context window •
Text input • 2 years ago
amazon_mistrallite:q5_K_M
069d9cd4303e • 5.1GB • 32K context window •
Text input • 2 years ago
amazon_mistrallite:q6_K
9aea65275900 • 5.9GB • 32K context window •
Text input • 2 years ago
amazon_mistrallite:q8_0
1a9265fd87b2 • 7.7GB • 32K context window •
Text input • 2 years ago
amazon_mistrallite:f16
f9a30be5a138 • 14GB • 32K context window •
Text input • 2 years ago