spooknik/
hermes-2-pro-mistral-7b:q8

1,456 1 year ago

Hermes 2 Pro on Mistral 7B is the new flagship 7B Hermes!

1 year ago

c39f3eef0937 · 7.7GB ·

model
llama
·
7.24B
·
Q8_0
params
{ "stop": [ "<|im_start|>", "<|im_end|>" ] }
template
<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi

Readme

Original Model | GGUF Quants

Hermes 2 Pro is an upgraded, retrained version of Nous Hermes 2, consisting of an updated and cleaned version of the OpenHermes 2.5 Dataset, as well as a newly introduced Function Calling and JSON Mode dataset developed in-house.

Overall a fine model, produces good results. Seems to be pretty factual and not too many guardrails.

I strongly recommend the highest quantization you can run. See tags and download the version that suits you best.

Feel free to contact me if you have problems

Reddit: /u/spooknik | Discord: .spooknik