This is an unofficial version of [Bonito](https://github.com/BatsResearch/bonito). I convert and quantize the model myself and extract the template from the [paper](https://arxiv.org/abs/2402.18334)

7B

31 Pulls Updated 5 months ago

b284f67e1ac2 · 85B
{ "stop": [ "<|task|>", "<|context|>", "\"<|tasktype|>\"" ] }