The model is an instruction-tuned variant of rinna/gemma-2-baku-2b, utilizing Chat Vector and Odds Ratio Preference Optimization (ORPO) for fine-tuning. It adheres to the gemma-2 chat format.

2B

14 Pulls Updated 8 days ago

4ea0df93422f · 445B
{{- $system := "" }} {{- range .Messages }} {{- if eq .Role "system" }} {{- if not $system }}{{ $system = .Content }} {{- else }}{{ $system = printf "%s\n\n%s" $system .Content }} {{- end }} {{- continue }} {{- else if eq .Role "user" }}<start_of_turn>user {{- if $system }} {{ $system }} {{- $system = "" }} {{- end }} {{- else if eq .Role "assistant" }}<start_of_turn>model {{- end }} {{ .Content }}<end_of_turn> {{ end }}<start_of_turn>model