ifioravanti/
openhermes2.5-neural-chat:7b-q4_0

90 1 year ago

This is the model for OpenHermes-2.5-neural-chat-v3-3-Slerp

7b

1 year ago

5c09baaf14c6 · 4.1GB ·

model
llama
·
7.24B
·
Q4_0
params
{ "num_ctx": 4096, "stop": [ "<|im_start|>", "<|im_end|>" ] }
template
<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi

Readme

image

CLI

ollama run ifioravanti/openhermes2.5-neural-chat

API

Example:

curl -X POST http://localhost:11434/api/generate -d '{ 
  "model": "openhermes2.5-neural-chat",
  "prompt": "Here is a story about llamas eating grass"
 }'

Memory requirements

  • 7b models generally require at least 8GB of RAM

References

Hugging Face