MHKetbi/ unsloth-QwQ-32B

889 1 year ago

Qwen-QwQ-32B with UNSLOTH bug fixes.

tools

8 models

unsloth-QwQ-32B:latest
109a588a2dff • 66GB • 128K context window •
Text input • 1 year ago
unsloth-QwQ-32B:q2_K_L
ff526a2951d3 • 12GB • 128K context window •
Text input • 1 year ago
unsloth-QwQ-32B:q2_K
f18f28a84210 • 12GB • 128K context window •
Text input • 1 year ago
unsloth-QwQ-32B:q3_K_M
46f4dbcbd35f • 16GB • 128K context window •
Text input • 1 year ago
unsloth-QwQ-32B:q4_K_M
ef5dbf66acf6 • 20GB • 128K context window •
Text input • 1 year ago
unsloth-QwQ-32B:q5_K_M
1b937c387d91 • 23GB • 128K context window •
Text input • 1 year ago
unsloth-QwQ-32B:q6_K
924535b2ecf4 • 27GB • 128K context window •
Text input • 1 year ago
unsloth-QwQ-32B:q8_0
7d33fdb54363 • 35GB • 128K context window •
Text input • 1 year ago