mistrallite

MistralLite is a fine-tuned model based on Mistral with enhanced capabilities of processing long contexts.

7B

23.5K Pulls Updated 11 months ago

Updated 11 months ago

11 months ago

5393d4f5f262 · 4.1GB

parameters7.24B

quantizationQ4_0

<|prompter|>{{ .System }} {{ .Prompt }}</s><|assistant|>

{"num_ctx":32768,"stop":["<|prompter|>","<|assistant|>","</s>"]}

Readme

Mistrallite is a fine-tuned model based on Mistral, with enhanced capabilities of processing long context (up to 32K tokens). This model is able to perform significantly better on several long context retrieve and answering tasks.

Reference