ehartford/ bigstral

295 2 years ago

This is mistralai/Mistral-7B-Instruct-v0.2 with layers interleaved to make a bigger 12b model

16 models

bigstral:latest
459d154d9165 • 7.1GB • 32K context window •
Text input • 2 years ago
bigstral:v0.2_q3_K_S
9d61197b0d32 • 5.4GB • 32K context window •
Text input • 2 years ago
bigstral:v0.2_q4_0 latest
459d154d9165 • 7.1GB • 32K context window •
Text input • 2 years ago
bigstral:q2_K
8e817d48a520 • 4.6GB • 32K context window •
Text input • 2 years ago
bigstral:q3_K_S
4717bb2a503a • 5.4GB • 32K context window •
Text input • 2 years ago
bigstral:q3_K_M
873f5a6fffe8 • 6.0GB • 32K context window •
Text input • 2 years ago
bigstral:q3_K_L
cc885e0f9c89 • 6.6GB • 32K context window •
Text input • 2 years ago
bigstral:q4_0
f21f61d351fa • 7.1GB • 32K context window •
Text input • 2 years ago
bigstral:q4_1
fb08cc1c3a16 • 7.8GB • 32K context window •
Text input • 2 years ago
bigstral:q5_0
5f5c8f0d6af1 • 8.6GB • 32K context window •
Text input • 2 years ago
bigstral:q5_1
33a2f7347ae4 • 9.4GB • 32K context window •
Text input • 2 years ago
bigstral:q5_K_S
ce85933b0ab8 • 8.6GB • 32K context window •
Text input • 2 years ago
bigstral:q5_K_M
8bfba1abae4f • 8.8GB • 32K context window •
Text input • 2 years ago
bigstral:q6_K
77ed3f01b210 • 10GB • 32K context window •
Text input • 2 years ago
bigstral:q8_0
d43f56de37a5 • 13GB • 32K context window •
Text input • 2 years ago
bigstral:f16
25fb0fc1798b • 25GB • 32K context window •
Text input • 2 years ago