koesn/
mistral-7b-instruct:Q4_K_M

1,336 1 year ago

Fixed num_ctx to 32768. This Mistral 7B v0.2 Instruct model is ready to use for full model's 32k contexts window.

... /
template
eb047791cc25 · 87B
<|im_start|>system
{{ .System }}
<|im_start|>user
{{ .Prompt }}
<|im_start|>assistant