madkoding/ ornith-1.5-9b-q2k:1.5-9b

19 2 days ago

Ornith-1.5-9B quantized to Q2_K (4.06 GB) — a good balance between size and quality. Runs with a 16k context window and leaves 2.1 GB of VRAM free

vision
... /
template
6dae8ffd6964 · 278B
{{- if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{- range .Messages }}{{ if eq .Role "user" }}<|im_start|>user
{{ .Content }}<|im_end|>
{{ else if eq .Role "assistant" }}<|im_start|>assistant
{{ .Content }}<|im_end|>
{{ end }}{{ end }}<|im_start|>assistant