💨 Notus 7B is an open source LLM released by Argilla, fine-tuned using Direct Preference Optimization (DPO) and AIF (AI Feedback) techniques. This model is fine-tuned with a better curated version of the Ultrafeedback dataset.
7B
27 Pulls Updated 10 months ago
093c79b06599 · 111B
"""Below is an instruction that describes a task. Write a response that appropriately completes the request."""