krith/ qwen2.5-32b-instruct

643 2 years ago

I-quants for qwen2.5-32b-instruct

tools

11 models

qwen2.5-32b-instruct:IQ3_M
d6b011816227 • 15GB • 32K context window •
Text input • 2 years ago
qwen2.5-32b-instruct:IQ1_S
42c5a34ab855 • 7.3GB • 32K context window •
Text input • 2 years ago
qwen2.5-32b-instruct:IQ1_M
5b23cd19815d • 7.9GB • 32K context window •
Text input • 2 years ago
qwen2.5-32b-instruct:IQ2_XXS
d4ad242370dc • 9.0GB • 32K context window •
Text input • 2 years ago
qwen2.5-32b-instruct:IQ2_XS
d6a8029fc542 • 10.0GB • 32K context window •
Text input • 2 years ago
qwen2.5-32b-instruct:IQ2_S
1c5a69c39b61 • 10GB • 32K context window •
Text input • 2 years ago
qwen2.5-32b-instruct:IQ2_M
b34bf6f0cde6 • 11GB • 32K context window •
Text input • 2 years ago
qwen2.5-32b-instruct:IQ3_XXS
e39c4029b9ff • 13GB • 32K context window •
Text input • 2 years ago
qwen2.5-32b-instruct:IQ3_XS
b2a6b567848b • 14GB • 32K context window •
Text input • 2 years ago
qwen2.5-32b-instruct:IQ3_S
a3e8e42eb345 • 14GB • 32K context window •
Text input • 2 years ago
qwen2.5-32b-instruct:IQ4_XS
270cd022b037 • 18GB • 32K context window •
Text input • 2 years ago