mattw/
amazon_mistrallite

54 1 year ago

Models

View all →

14 models

amazon_mistrallite:q2_K

3.1GB · 32K context window · Text · 1 year ago

amazon_mistrallite:q3_K_S

3.2GB · 32K context window · Text · 1 year ago

amazon_mistrallite:q3_K_M

3.5GB · 32K context window · Text · 1 year ago

amazon_mistrallite:q3_K_L

3.8GB · 32K context window · Text · 1 year ago

amazon_mistrallite:q4_1

4.6GB · 32K context window · Text · 1 year ago

amazon_mistrallite:q4_K_S

4.1GB · 32K context window · Text · 1 year ago

amazon_mistrallite:q4_K_M

4.4GB · 32K context window · Text · 1 year ago

amazon_mistrallite:q5_0

5.0GB · 32K context window · Text · 1 year ago

amazon_mistrallite:q5_1

5.4GB · 32K context window · Text · 1 year ago

amazon_mistrallite:q5_K_S

5.0GB · 32K context window · Text · 1 year ago

amazon_mistrallite:q5_K_M

5.1GB · 32K context window · Text · 1 year ago

amazon_mistrallite:q6_K

5.9GB · 32K context window · Text · 1 year ago

amazon_mistrallite:q8_0

7.7GB · 32K context window · Text · 1 year ago

amazon_mistrallite:f16

14GB · 32K context window · Text · 1 year ago

Readme

No readme