koesn / mistral-7b-instruct

Fixed num_ctx to 32768. This Mistral 7B v0.2 Instruct model is ready to use for full model's 32k contexts window.

7B

186 Pulls Updated 4 months ago

5 Tags
latest
39d8715d6a19 • 4.1GB • Updated 4 months ago
Q4_0
latest
39d8715d6a19 • 4.1GB • Updated 4 months ago
Q4_K_M
c8a5a62846a3 • 4.4GB • Updated 4 months ago
Q5_K_M
81a09b1a22e2 • 5.1GB • Updated 4 months ago
Q6_K
6e0226662051 • 5.9GB • Updated 4 months ago