argilla / notus

💨 Notus 7B is an open source LLM released by Argilla, fine-tuned using Direct Preference Optimization (DPO) and AIF (AI Feedback) techniques. This model is fine-tuned with a better curated version of the Ultrafeedback dataset.

7B

385 Pulls Updated 9 months ago

... /
params
aa351e4a3def · 113B
{ "num_ctx": 8192, "stop": [ "<|system|>", "<|user|>", "<|assistant|>", "</s>" ] }