znbang/
breeze

194 1 year ago

Breeze-7B is a language model family that builds on top of Mistral-7B, specifically intended for Traditional Chinese use.

Models

View all →

14 models

breeze:7b-instruct-v0.1-Q2_K

3.2GB · 32K context window · Text · 1 year ago

breeze:7b-instruct-v0.1-Q3_K_S

3.3GB · 32K context window · Text · 1 year ago

breeze:7b-instruct-v0.1-Q3_K_M

3.7GB · 32K context window · Text · 1 year ago

breeze:7b-instruct-v0.1-Q3_K_L

4.0GB · 32K context window · Text · 1 year ago

breeze:7b-instruct-v0.1-Q4_0

4.3GB · 32K context window · Text · 1 year ago

breeze:7b-instruct-v0.1-Q4_1

4.7GB · 32K context window · Text · 1 year ago

breeze:7b-instruct-v0.1-Q4_K_S

4.3GB · 32K context window · Text · 1 year ago

breeze:7b-instruct-v0.1-Q4_K_M

4.5GB · 32K context window · Text · 1 year ago

breeze:7b-instruct-v0.1-Q5_0

5.2GB · 32K context window · Text · 1 year ago

breeze:7b-instruct-v0.1-Q5_1

5.6GB · 32K context window · Text · 1 year ago

breeze:7b-instruct-v0.1-Q5_K_S

5.2GB · 32K context window · Text · 1 year ago

breeze:7b-instruct-v0.1-Q5_K_M

5.3GB · 32K context window · Text · 1 year ago

breeze:7b-instruct-v0.1-Q6_K

6.1GB · 32K context window · Text · 1 year ago

breeze:7b-instruct-v0.1-Q8_0

8.0GB · 32K context window · Text · 1 year ago

Readme

Reference: Breeze-7B-Instruct-v0_1