23 1 year ago

DPO finetuned model from FusionNet_7Bx2_MoE_14B