madkoding/ ornith-1.5-9b-iq2m:latest

18 2 days ago

Ornith-1.5-9B quantized to IQ2_M (3.77 GB) — the most aggressive compression available for this model. Ideal for low-VRAM GPUs. Runs with a 16k context window while leaving 2.5 GB of VRAM free. Slightly faster at the cost of some precision

vision
... /
template
6dae8ffd6964 · 278B
{{- if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{- range .Messages }}{{ if eq .Role "user" }}<|im_start|>user
{{ .Content }}<|im_end|>
{{ else if eq .Role "assistant" }}<|im_start|>assistant
{{ .Content }}<|im_end|>
{{ end }}{{ end }}<|im_start|>assistant