mistrallite:7b-v0.1-q5_K_M

33.9K 1 year ago

MistralLite is a fine-tuned model based on Mistral with enhanced capabilities of processing long contexts.

7b

1 year ago

7a3f8c87136f · 5.1GB

model
llama
·
7.24B
·
Q5_K_M
params
{ "num_ctx": 32768, "stop": [ "<|prompter|>", "<|assistant|>", "</s>
template
<|prompter|>{{ .System }} {{ .Prompt }}</s><|assistant|>

Readme

Mistrallite is a fine-tuned model based on Mistral, with enhanced capabilities of processing long context (up to 32K tokens). This model is able to perform significantly better on several long context retrieve and answering tasks.

Reference

Hugging Face