💨 Notus 7B is an open source LLM released by Argilla, fine-tuned using Direct Preference Optimization (DPO) and AIF (AI Feedback) techniques. This model is fine-tuned with a better curated version of the Ultrafeedback dataset.
7B
27 Pulls Updated 10 months ago
12 Tags
ec191d8f42e1 • 3.1GB •
Updated 10 months ago
bf80896b7eb0 • 3.2GB •
Updated 10 months ago
177daa32a365 • 3.5GB •
Updated 10 months ago
2e6be4149ff8 • 3.8GB •
Updated 10 months ago
005debe52cc3 • 4.1GB •
Updated 10 months ago
84cae034aada • 4.1GB •
Updated 10 months ago
af2594c818e6 • 4.4GB •
Updated 10 months ago
7beb5e05be80 • 5.0GB •
Updated 10 months ago
ba52acaba1a3 • 539MB •
Updated 10 months ago
1251b4fd2a93 • 5.1GB •
Updated 10 months ago
078332f0dea1 • 5.9GB •
Updated 10 months ago
75975a5854c5 • 7.7GB •
Updated 10 months ago