spooknik/
hermes-2-pro-mistral-7b

1,456 1 year ago

Hermes 2 Pro on Mistral 7B is the new flagship 7B Hermes!

Models

View all →

5 models

hermes-2-pro-mistral-7b:latest

4.4GB · 32K context window · Text · 1 year ago

hermes-2-pro-mistral-7b:q8

7.7GB · 32K context window · Text · 1 year ago

hermes-2-pro-mistral-7b:q4_k_s

4.4GB · 32K context window · Text · 1 year ago

hermes-2-pro-mistral-7b:q5_k_s

5.0GB · 32K context window · Text · 1 year ago

hermes-2-pro-mistral-7b:q6_k

5.9GB · 32K context window · Text · 1 year ago

Readme

Original Model | GGUF Quants

Hermes 2 Pro is an upgraded, retrained version of Nous Hermes 2, consisting of an updated and cleaned version of the OpenHermes 2.5 Dataset, as well as a newly introduced Function Calling and JSON Mode dataset developed in-house.

Overall a fine model, produces good results. Seems to be pretty factual and not too many guardrails.

I strongly recommend the highest quantization you can run. See tags and download the version that suits you best.

Feel free to contact me if you have problems

Reddit: /u/spooknik | Discord: .spooknik