argilla / notus

💨 Notus 7B is an open source LLM released by Argilla, fine-tuned using Direct Preference Optimization (DPO) and AIF (AI Feedback) techniques. This model is fine-tuned with a better curated version of the Ultrafeedback dataset.

385 Pulls Updated 9 months ago

13 Tags

4008f13b1b66 • 4.4GB • Updated 9 months ago

308e4fdb1370 • 3.1GB • Updated 9 months ago

9599ffaff939 • 3.2GB • Updated 9 months ago

dcf5a7cb55d6 • 3.5GB • Updated 9 months ago

67f4c4f6e741 • 3.8GB • Updated 9 months ago

0bc77dcd65a7 • 4.1GB • Updated 9 months ago

e23ca1f22d69 • 4.1GB • Updated 9 months ago

39ac45837742 • 4.4GB • Updated 9 months ago

2ea9ce290a7b • 5.0GB • Updated 9 months ago

4d048447c0fd • 539MB • Updated 9 months ago

35fdbbe0b6c0 • 5.1GB • Updated 9 months ago

276eca4e645e • 5.9GB • Updated 9 months ago

1abb30985b17 • 7.7GB • Updated 9 months ago