311 Downloads Updated 2 years ago
ollama run rouge/daybreak-kunoichi-2dpo-7b
Updated 2 years ago
2 years ago
4742d588810c · 7.7GB ·
Source: https://huggingface.co/crestf411/daybreak-kunoichi-2dpo-7b
Experimental model doing a DPO training on top of Kunoichi-DPO-v2-7b, i.e. double-DPO.