argilla / notus

💨 Notus 7B is an open source LLM released by Argilla, fine-tuned using Direct Preference Optimization (DPO) and AIF (AI Feedback) techniques. This model is fine-tuned with a better curated version of the Ultrafeedback dataset.

7B

385 Pulls Updated 9 months ago

... /
template
aa5b5282ad4f · 106B
"{{- if .System }}<|system|>\n{{ .System }}</s>\n{{- end }}\n<|user|>\n{{ .Prompt }}</s>\n<|assistant|>\n"