krith/
meta-llama-3.1-8b-instruct

183 11 months ago

I-quants for meta-llama-3.1-8b-instruct

tools

11 models

meta-llama-3.1-8b-instruct:IQ3_M
fd9097759556 • 3.8GB • 128K context window •
Text input • 11 months ago
meta-llama-3.1-8b-instruct:IQ1_S
4cdc1d534229 • 2.0GB • 128K context window •
Text input • 11 months ago
meta-llama-3.1-8b-instruct:IQ1_M
22d000de60a5 • 2.2GB • 128K context window •
Text input • 11 months ago
meta-llama-3.1-8b-instruct:IQ2_XXS
7e31dfd808a9 • 2.4GB • 128K context window •
Text input • 11 months ago
meta-llama-3.1-8b-instruct:IQ2_XS
9cad5987f334 • 2.6GB • 128K context window •
Text input • 11 months ago
meta-llama-3.1-8b-instruct:IQ2_S
a98fd3f7190a • 2.8GB • 128K context window •
Text input • 11 months ago
meta-llama-3.1-8b-instruct:IQ2_M
1cb1149acd9b • 2.9GB • 128K context window •
Text input • 11 months ago
meta-llama-3.1-8b-instruct:IQ3_XXS
865e3c6fc012 • 3.3GB • 128K context window •
Text input • 11 months ago
meta-llama-3.1-8b-instruct:IQ3_XS
fa9e7c6b744a • 3.5GB • 128K context window •
Text input • 11 months ago
meta-llama-3.1-8b-instruct:IQ3_S
0f39f0ff0795 • 3.7GB • 128K context window •
Text input • 11 months ago
meta-llama-3.1-8b-instruct:IQ4_XS
e38a8fa03138 • 4.4GB • 128K context window •
Text input • 11 months ago