madkoding/ ornith-1.5-9b-q2k:1.5-9b

19 2 days ago

Ornith-1.5-9B quantized to Q2_K (4.06 GB) — a good balance between size and quality. Runs with a 16k context window and leaves 2.1 GB of VRAM free

vision
... /
params
c48d2a5f1396 · 60B
{
"num_ctx": 16384,
"temperature": 0.5,
"top_k": 20,
"top_p": 0.95
}