18 2 days ago

Preference-aligned conversational assistant based on Qwen3-1.7B-Base. Fine-tuned using UltraChat and optimized with DPO on UltraFeedback, Intel Orca and Capybara

c8472cd9daed · 31B
You are a helpful AI assistant.