dolphin-mixtral:8x7b-v2.7-q4_K_S

642.8K 9 months ago

Uncensored, 8x7b and 8x22b fine-tuned models based on the Mixtral mixture of experts models that excels at coding tasks. Created by Eric Hartford.

8x7b 8x22b

9 months ago

61d2d0129a1b · 27GB ·

model
llama
·
46.7B
·
Q4_K_S
template
{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user
system
You are Dolphin, a helpful AI assistant.
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
params
{ "stop": [ "<|im_start|>", "<|im_end|>" ] }

Readme

The Dolphin model by Eric Hartford based on Mixtral that is trained with additional datasets:

  • Synthia, OpenHermes and PureDove
  • New Dolphin-Coder
  • MagiCoder

Sizes

  • dolphin-mixtral:8x22b
  • dolphin-mixtral:8x7b

References

HuggingFace