krith/ qwen2.5-7b-instruct

975 2 years ago

I-quants for qwen2.5-7b-instruct

tools

11 models

qwen2.5-7b-instruct:IQ3_M
6abd761914e7 • 3.6GB • 32K context window •
Text input • 2 years ago
qwen2.5-7b-instruct:IQ1_S
69f3dd61d53c • 1.9GB • 32K context window •
Text input • 2 years ago
qwen2.5-7b-instruct:IQ1_M
2ea894f6eb5c • 2.0GB • 32K context window •
Text input • 2 years ago
qwen2.5-7b-instruct:IQ2_XXS
94789337e4c2 • 2.3GB • 32K context window •
Text input • 2 years ago
qwen2.5-7b-instruct:IQ2_XS
374a7b9ebecc • 2.5GB • 32K context window •
Text input • 2 years ago
qwen2.5-7b-instruct:IQ2_S
b095895da2b7 • 2.6GB • 32K context window •
Text input • 2 years ago
qwen2.5-7b-instruct:IQ2_M
5f40ec73781d • 2.8GB • 32K context window •
Text input • 2 years ago
qwen2.5-7b-instruct:IQ3_XXS
5c7720507f21 • 3.1GB • 32K context window •
Text input • 2 years ago
qwen2.5-7b-instruct:IQ3_XS
0f93bb076718 • 3.3GB • 32K context window •
Text input • 2 years ago
qwen2.5-7b-instruct:IQ3_S
424b1ee91d06 • 3.5GB • 32K context window •
Text input • 2 years ago
qwen2.5-7b-instruct:IQ4_XS
fad1f5e8b6e7 • 4.2GB • 32K context window •
Text input • 2 years ago