Preference-aligned conversational assistant based on Qwen3-1.7B-Base. Fine-tuned using UltraChat and optimized with DPO on UltraFeedback, Intel Orca and Capybara
93 Pulls 6 Tags Updated 1 month ago
