Preference-aligned conversational assistant based on Qwen3-1.7B-Base. Fine-tuned using UltraChat and optimized with DPO on UltraFeedback, Intel Orca and Capybara
21 Pulls 6 Tags Updated 3 days ago
