krith/
qwen2.5-72b-instruct

406 1 year ago

I-quants for qwen2.5-72b-instruct

tools

11 models

qwen2.5-72b-instruct:IQ3_M
2178fad972b5 • 36GB • 32K context window •
Text input • 1 year ago
qwen2.5-72b-instruct:IQ1_S
308ba167d7d0 • 23GB • 32K context window •
Text input • 1 year ago
qwen2.5-72b-instruct:IQ1_M
10a9eca467ef • 24GB • 32K context window •
Text input • 1 year ago
qwen2.5-72b-instruct:IQ2_XXS
39aa0aa3e6c8 • 25GB • 32K context window •
Text input • 1 year ago
qwen2.5-72b-instruct:IQ2_XS
013b7d824bd8 • 27GB • 32K context window •
Text input • 1 year ago
qwen2.5-72b-instruct:IQ2_S
918118f26d87 • 28GB • 32K context window •
Text input • 1 year ago
qwen2.5-72b-instruct:IQ2_M
ddf4ae366d50 • 29GB • 32K context window •
Text input • 1 year ago
qwen2.5-72b-instruct:IQ3_XXS
538cd1e686e6 • 32GB • 32K context window •
Text input • 1 year ago
qwen2.5-72b-instruct:IQ3_XS
3bbac554beaf • 33GB • 32K context window •
Text input • 1 year ago
qwen2.5-72b-instruct:IQ3_S
1a98e880255a • 34GB • 32K context window •
Text input • 1 year ago
qwen2.5-72b-instruct:IQ4_XS
1403e8e1f96a • 40GB • 32K context window •
Text input • 1 year ago