rouge/
daybreak-kunoichi-2dpo-7b

269 1 year ago

Experimental model doing a DPO training on top of Kunoichi-DPO-v2-7b, i.e. double-DPO.

Models

View all →

1 model

daybreak-kunoichi-2dpo-7b:latest

7.7GB · 16K context window · Text · 1 year ago

Readme

Source: https://huggingface.co/crestf411/daybreak-kunoichi-2dpo-7b

Experimental model doing a DPO training on top of Kunoichi-DPO-v2-7b, i.e. double-DPO.