spooknik / hermes-2-pro-mistral-7b

Hermes 2 Pro on Mistral 7B is the new flagship 7B Hermes!

7B

678 Pulls Updated 6 months ago

6 months ago

de112ac89d8c · 5.0GB

model
llama
·
7.24B
·
Q5_K_S
params
{"stop":["<|im_start|>","<|im_end|>"]}
template
<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assistant

Readme

Original Model | GGUF Quants

Hermes 2 Pro is an upgraded, retrained version of Nous Hermes 2, consisting of an updated and cleaned version of the OpenHermes 2.5 Dataset, as well as a newly introduced Function Calling and JSON Mode dataset developed in-house.

Overall a fine model, produces good results. Seems to be pretty factual and not too many guardrails.

I strongly recommend the highest quantization you can run. See tags and download the version that suits you best.

Feel free to contact me if you have problems

Reddit: /u/spooknik | Discord: .spooknik