40 8 months ago

I present to you one of my first, most coherent models, a QLOrA finetune created with publicly available information and datasets. Based off of Mistral-7B. NOTE: Only really predicts text as of recent tests. (yes it can talk to itself for some reason)

98ecece072b6 ยท 195B
{
"num_ctx": 8192,
"repeat_penalty": 1.2,
"stop": [
"[INST]",
"[/INST]",
"</s>",
"[User]",
"[Model]",
"[System]",
"[End]",
"[Instruction]",
"[INST",
"[User",
"<|",
"User:",
"###"
],
"temperature": 0.5
}