48 11 months ago

A more experimental and buggy, but smaller model. A QLOrA finetune created with publicly available information and datasets. Based off of TinyLlama:1.1b. (AS OF RECENT TESTS, THIS MODEL IS ABLE TO RESPOND BETTER AND FASTER THAN GIBBER 2, NOT PERFECTLY.)

38f52f56b182 ยท 146B
{{ if .System }}<|system|>
{{ .System }}</s>
{{ end }}{{ if .Prompt }}<|user|>
{{ .Prompt }}</s>
{{ end }}<|assistant|>
{{ .Response }}</s>