NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO Korean Finetuned q4 model with SFT->DPO

56b

3 2 months ago

e716af141429 · 105B
<|im_start|>system
{{ .System }}<|im_end|>
<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant