mistral-openorca

Mistral OpenOrca is a 7 billion parameter model, fine-tuned on top of the Mistral 7B model using the OpenOrca dataset.

119.6K Pulls Updated 6 months ago

Updated 6 months ago

6 months ago

12dc6acc14d0 · 4.1GB

quantization4-bit

{"stop":["<|im_start|>","<|im_end|>"]}

{{- if .System }} <|im_start|>system {{ .System }}<|im_end|> {{- end }} <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assistant

Readme

Mistral OpenOrca is a 7 billion parameter model, fine-tuned on top of the Mistral 7B model using the OpenOrca dataset.

HuggingFace Leaderboard evals place this model as leader for all models smaller than 30B at the release time, outperforming all other 7B and 13B models.

Usage

CLI

ollama run mistral-openorca "Why is the sky blue?"

API

curl -X POST http://localhost:11434/api/generate -d '{
  "model": "mistral-openorca",
  "prompt": "Why is the sky blue?"
}'

More information

HuggingFace repo