mannix/
qwq-32b

383 9 months ago

QwQ is an experimental research model focused on advancing AI reasoning capabilities. i-matrix quantizations.

tools

23 models

qwq-32b:latest
8a21d0911dd3 • 20GB • 32K context window •
Text input • 9 months ago
qwq-32b:q2_k
2742cb75d404 • 12GB • 32K context window •
Text input • 9 months ago
qwq-32b:q3_k_s
b4476592c415 • 14GB • 32K context window •
Text input • 9 months ago
qwq-32b:q3_k_m
f2ac04d4f533 • 16GB • 32K context window •
Text input • 9 months ago
qwq-32b:q3_k_l
20a448c1bbcd • 17GB • 32K context window •
Text input • 9 months ago
qwq-32b:q4_0
7f92ba7ce720 • 19GB • 32K context window •
Text input • 9 months ago
qwq-32b:q4_1
92feda76b425 • 21GB • 32K context window •
Text input • 9 months ago
qwq-32b:q4_k_s
e4bed4d5ac50 • 19GB • 32K context window •
Text input • 9 months ago
qwq-32b:Q4_K_M
8a21d0911dd3 • 20GB • 32K context window •
Text input • 9 months ago
qwq-32b:q5_0
da55bf655966 • 23GB • 32K context window •
Text input • 9 months ago
qwq-32b:q5_1
3c4554ef55b9 • 25GB • 32K context window •
Text input • 9 months ago
qwq-32b:q5_k_s
159861cc67b1 • 23GB • 32K context window •
Text input • 9 months ago
qwq-32b:q5_k_m
79161bd27515 • 23GB • 32K context window •
Text input • 9 months ago
qwq-32b:q6_k
c9a0ff244b14 • 27GB • 32K context window •
Text input • 9 months ago
qwq-32b:q8_0
434c0f008425 • 35GB • 32K context window •
Text input • 9 months ago
qwq-32b:iq2_xxs
a2c3e932790a • 9.0GB • 32K context window •
Text input • 9 months ago
qwq-32b:iq2_xs
652334a01618 • 10.0GB • 32K context window •
Text input • 9 months ago
qwq-32b:iq2_s
0afaf892ce79 • 10GB • 32K context window •
Text input • 9 months ago
qwq-32b:iq3_xxs
3cd9a9af6b8c • 13GB • 32K context window •
Text input • 9 months ago
qwq-32b:iq3_xs
7d0b09f45697 • 14GB • 32K context window •
Text input • 9 months ago
qwq-32b:iq3_s
61974b1ca1ee • 14GB • 32K context window •
Text input • 9 months ago
qwq-32b:iq4_xs
da5a835492b2 • 18GB • 32K context window •
Text input • 9 months ago
qwq-32b:iq4_nl
7dcfce8b0c9c • 19GB • 32K context window •
Text input • 9 months ago