27 3 days ago

Ornith-1.5-9B quantized to Q2_K (4.06 GB) — a good balance between size and quality. Runs with a 16k context window and leaves 2.1 GB of VRAM free

vision
ollama run madkoding/ornith-1.5-9b-q2k:1.5-9b

Details

3 days ago

95e24ab8dd20 · 5.0GB ·

qwen35
·
8.95B
·
Q2_K
clip
·
456M
·
F16
{{- if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{- range .Messages }}{{ if eq
{ "num_ctx": 16384, "temperature": 0.5, "top_k": 20, "top_p": 0.95 }

Readme

No readme