Zephyr is a series of fine-tuned versions of the Mistral and Mixtral models that are trained to act as helpful assistants.
7B
141B
74.7K Pulls Updated 4 weeks ago
141b-v0.1
80GB
141b-v0.1-q4_0
80GB
141b-v0.1-q8_0
149GB
141b-v0.1-q2_K
52GB
141b-v0.1-fp16
281GB
7b-alpha
4.1GB
7b-beta
4.1GB
7b-alpha-q4_0
4.1GB
7b-alpha-q4_1
4.6GB
7b-alpha-q5_0
5.0GB
7b-alpha-q5_1
5.4GB
7b-alpha-q8_0
7.7GB
7b-alpha-q2_K
3.1GB
7b-alpha-q3_K_S
3.2GB
7b-alpha-q3_K_M
3.5GB
7b-alpha-q3_K_L
3.8GB
7b-alpha-q4_K_S
4.1GB
7b-alpha-q4_K_M
4.4GB
7b-alpha-q5_K_S
5.0GB
7b-alpha-q5_K_M
5.1GB
7b-alpha-q6_K
5.9GB
7b-alpha-fp16
14GB
7b-beta-q4_0
4.1GB
7b-beta-q4_1
4.6GB
7b-beta-q5_0
5.0GB
7b-beta-q5_1
5.4GB
7b-beta-q8_0
7.7GB
7b-beta-q2_K
3.1GB
7b-beta-q3_K_S
3.2GB
7b-beta-q3_K_M
3.5GB
7b-beta-q3_K_L
3.8GB
7b-beta-q4_K_S
4.1GB
7b-beta-q4_K_M
4.4GB
7b-beta-q5_K_S
5.0GB
7b-beta-q5_K_M
5.1GB
7b-beta-q6_K
5.9GB
7b-beta-fp16
14GB