This is an unofficial version of [Bonito](https://github.com/BatsResearch/bonito). I convert and quantize the model myself and extract the template from the [paper](https://arxiv.org/abs/2402.18334)
36 Pulls Updated 8 months ago
Updated 8 months ago
8 months ago
21006918e2d2 · 4.4GB
model
archllama
·
parameters7.24B
·
quantizationQ4_K_M
4.4GB
params
{"stop":["\u003c|task|\u003e","\u003c|context|\u003e","\"\u003c|tasktype|\u003e\""]}
85B
template
<|tasktype|>
{{ if .System }}{{ .System }}{{ end }}
<|context|>
{{ .Prompt }}
<|task|>
87B
Readme
This is an unofficial version of Bonito. I convert and quantize the model myself and extract the template from the paper
Check the current task type by using >>>/show system
Set support task types by using >>>/set system
[support task type]
The support task types are
SHORTFORM_TO_FULL_TASK_TYPES = {
"exqa": "extractive question answering",
"mcqa": "multiple-choice question answering",
"qg": "question generation",
"qa": "question answering without choices",
"ynqa": "yes-no question answering",
"coref": "coreference resolution",
"paraphrase": "paraphrase generation",
"paraphrase_id": "paraphrase identification",
"sent_comp": "sentence completion",
"sentiment": "sentiment",
"summarization": "summarization",
"text_gen": "text generation",
"topic_class": "topic classification",
"wsd": "word sense disambiguation",
"te": "textual entailment",
"nli": "natural language inference",
}
shown here https://github.com/BatsResearch/bonito/blob/main/bonito/abstract.py#L5 at SHORTFORM_TO_FULL_TASK_TYPES
variable.