This is an unofficial version of [Bonito](https://github.com/BatsResearch/bonito). I convert and quantize the model myself and extract the template from the [paper](https://arxiv.org/abs/2402.18334)
36 Pulls Updated 8 months ago
f03ae9960fea · 87B
<|tasktype|>
{{ if .System }}{{ .System }}{{ end }}
<|context|>
{{ .Prompt }}
<|task|>