NousResearch/Hermes-2-Pro-Mistral-7B fine-tuned on mlabonne/orpo-dpo-mix-40k dataset

23 Pulls Updated 3 months ago

Readme

Test of fine tuning with mlabonne/orpo-dpo-mix-40k dataset
on NousResearch/Hermes-2-Pro-Mistral-7B model