Experimental model doing a DPO training on top of Kunoichi-DPO-v2-7b, i.e. double-DPO.

230  Pulls Updated  10 months ago