koesn/
mistral-7b-instruct

2,168 1 year ago

Fixed num_ctx to 32768. This Mistral 7B v0.2 Instruct model is ready to use for full model's 32k contexts window.

5 models

mistral-7b-instruct:latest
39d8715d6a19 • 4.1GB • 32K context window •
Text input • 1 year ago
mistral-7b-instruct:Q4_0
39d8715d6a19 • 4.1GB • 32K context window •
Text input • 1 year ago
mistral-7b-instruct:Q4_K_M
c8a5a62846a3 • 4.4GB • 32K context window •
Text input • 1 year ago
mistral-7b-instruct:Q5_K_M
81a09b1a22e2 • 5.1GB • 32K context window •
Text input • 1 year ago
mistral-7b-instruct:Q6_K
6e0226662051 • 5.9GB • 32K context window •
Text input • 1 year ago