💨 Notus 7B is an open source LLM released by Argilla, fine-tuned using Direct Preference Optimization (DPO) and AIF (AI Feedback) techniques. This model is fine-tuned with a better curated version of the Ultrafeedback dataset.
7B
385 Pulls Updated 9 months ago
13 Tags
4008f13b1b66 • 4.4GB •
Updated 9 months ago
308e4fdb1370 • 3.1GB •
Updated 9 months ago
9599ffaff939 • 3.2GB •
Updated 9 months ago
dcf5a7cb55d6 • 3.5GB •
Updated 9 months ago
67f4c4f6e741 • 3.8GB •
Updated 9 months ago
0bc77dcd65a7 • 4.1GB •
Updated 9 months ago
e23ca1f22d69 • 4.1GB •
Updated 9 months ago
39ac45837742 • 4.4GB •
Updated 9 months ago
2ea9ce290a7b • 5.0GB •
Updated 9 months ago
4d048447c0fd • 539MB •
Updated 9 months ago
35fdbbe0b6c0 • 5.1GB •
Updated 9 months ago
276eca4e645e • 5.9GB •
Updated 9 months ago
1abb30985b17 • 7.7GB •
Updated 9 months ago