yabi / breeze-7b-32k-instruct-v1_0_q5_k

MediaTek Research Breeze-7B (hereinafter referred to as Breeze-7B) is a language model family that builds on top of Mistral-7B, specifically intended for Traditional Chinese use.

7B

16 Pulls Updated 4 months ago

... /
params
5d0ee45517b8 · 162B
{ "num_ctx": 32768, "num_gpu": -1, "num_thread": 8, "penalize_newline": false, "repeat_penalty": 1.1, "stop": [ "[INST]", "[/INST]" ], "temperature": 0.01, "top_k": 1, "top_p": 0.01 }