21 3 days ago

Preference-aligned conversational assistant based on Qwen3-1.7B-Base. Fine-tuned using UltraChat and optimized with DPO on UltraFeedback, Intel Orca and Capybara

e3b2721cec51 · 102B
{{- range .Messages }}<|im_start|>{{ .Role }}
{{ .Content }}<|im_end|>
{{ end }}<|im_start|>assistant