koesn/
mistral-7b-instruct:Q4_K_M

1,336 1 year ago

Fixed num_ctx to 32768. This Mistral 7B v0.2 Instruct model is ready to use for full model's 32k contexts window.

... /
params
90976b326ae6 · 75B
{
"num_ctx": 32768,
"stop": [
"<|im_start|>",
"<|im_end|>"
]
}