cookieshake/
a.x-4.0-light-imatrix

88 4 months ago

Quantized version of skt/A.X-4.0-Light

tools

Models

View all →

29 models

a.x-4.0-light-imatrix:iq3_m

3.4GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:q2_k

2.8GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:q2_k_s

2.6GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:q3_k_s

3.3GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:q3_k_m

3.6GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:q3_k_l

3.9GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:q4_0

4.2GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:q4_1

4.6GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:q4_k_s

4.2GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:q4_k_m

4.4GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:q5_0

5.1GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:q5_1

5.5GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:q5_k_s

5.0GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:q5_k_m

5.2GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:q6_k

6.0GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:Q8_0

7.7GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:iq1_s

1.7GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:iq1_m

1.9GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:iq2_xxs

2.1GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:iq2_xs

2.3GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:iq2_s

2.4GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:iq2_m

2.6GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:iq3_xxs

2.9GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:iq3_xs

3.1GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:iq3_s

3.3GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:iq4_xs

4.0GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:iq4_nl

4.2GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:tq1_0

1.9GB · 16K context window · Text · 4 months ago

a.x-4.0-light-imatrix:tq2_0

2.2GB · 16K context window · Text · 4 months ago

Readme

No readme