This is an unofficial version of [Bonito](https://github.com/BatsResearch/bonito). I convert and quantize the model myself and extract the template from the [paper](https://arxiv.org/abs/2402.18334)

36 8 months ago

... /
params
b284f67e1ac2 · 85B
{
"stop": [
"<|task|>",
"<|context|>",
"\"<|tasktype|>\""
]
}