cookieshake/ a.x-4.0-light-imatrix

378 1 year ago

Quantized version of skt/A.X-4.0-Light

tools

29 models

a.x-4.0-light-imatrix:iq3_m
77c8f80f7042 • 3.4GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:q2_k
d962c2de085e • 2.8GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:q2_k_s
b5d109b41044 • 2.6GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:q3_k_s
6254aef5ae2d • 3.3GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:q3_k_m
2ddcd434af6e • 3.6GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:q3_k_l
31eba46e4c3c • 3.9GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:q4_0
09dcaa8f4fac • 4.2GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:q4_1
7c7e3bb53a9c • 4.6GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:q4_k_s
949d56bd0cdb • 4.2GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:q4_k_m
96db58586df5 • 4.4GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:q5_0
50eb731f2c40 • 5.1GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:q5_1
1856cc3c5413 • 5.5GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:q5_k_s
5c456ba5de56 • 5.0GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:q5_k_m
d808621c7b7c • 5.2GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:q6_k
6f11495f0a73 • 6.0GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:Q8_0
f37f96212390 • 7.7GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:iq1_s
a6c0b88bb609 • 1.7GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:iq1_m
aa358b694f72 • 1.9GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:iq2_xxs
c18d41921797 • 2.1GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:iq2_xs
be829c64a59e • 2.3GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:iq2_s
40d8513a4ca0 • 2.4GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:iq2_m
5f295bb12ccc • 2.6GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:iq3_xxs
db3f6f2f2725 • 2.9GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:iq3_xs
adca3b2c656b • 3.1GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:iq3_s
931caa38766b • 3.3GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:iq4_xs
45764850eebc • 4.0GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:iq4_nl
e319d48f28b3 • 4.2GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:tq1_0
d77a1d776af7 • 1.9GB • 16K context window •
Text input • 1 year ago
a.x-4.0-light-imatrix:tq2_0
29b519bedd0a • 2.2GB • 16K context window •
Text input • 1 year ago