NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO Korean Finetuned q8 model with SFT->DPO

56b

5 3 months ago

e716af141429 · 105B
<|im_start|>system
{{ .System }}<|im_end|>
<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant