33 2 years ago

๐Ÿ’จ Notus 7B is an open source LLM released by Argilla, fine-tuned using Direct Preference Optimization (DPO) and AIF (AI Feedback) techniques. This model is fine-tuned with a better curated version of the Ultrafeedback dataset.

d8ba2f9a17b3 ยท 18B
{
"temperature": 1
}