27  Downloads Updated  3 days ago

Ornith-1.5-9B quantized to Q2_K (4.06 GB) — a good balance between size and quality. Runs with a 16k context window and leaves 2.1 GB of VRAM free