adrienbrault/
nous-hermes2pro:Q8_0

4,937 1 year ago

NousResearch/Hermes-2-Pro-Mistral-7B

1 year ago

6a27c314f9b1 · 7.7GB

model
llama
·
7.24B
·
Q8_0
license
Apache License 2.0
params
{ "stop": [ "<|im_start|>", "<|im_end|>" ] }
template
{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user

Readme

github.com/adrienbrault/ollama-nous-hermes2pro

Ollama models of NousResearch/Hermes-2-Pro-Mistral-7B-GGUF.

$ ollama run adrienbrault/nous-hermes2pro:Q4_0 'Hey!'

Hello! How can I help you today? If you have any questions or need assistance, feel free to ask.

There are -tools and -json tags with the recommended system prompt for function calling and json mode.

You provide the tools with the user message:

$ ollama run adrienbrault/nous-hermes2pro:Q4_0-tools "<tools>$(cat examples/tool-stock.json)</tools>

Fetch the stock fundamentals data for Tesla (TSLA)"

<tool_call>
{"arguments": {"symbol": "TSLA"}, "name": "get_stock_fundamentals"}
</tool_call>

Or a schema for the json mode:

$ ollama run adrienbrault/nous-hermes2pro:Q4_0-json "<schema>$(cat examples/user-schema.json)<schema>

Adrien Brault was born in 1991"

{"firstName": "Adrien", "lastName": "Brault", "age": 30}