188 2 years ago

q3_K_M and q4_K_M configured with 10k context

488ec452740d ยท 43B
{
"num_ctx": 5125,
"stop": [
"</s>"
]
}