ifioravanti / openhermes2.5-neural-chat

This is the model for OpenHermes-2.5-neural-chat-v3-3-Slerp

7b

80 Pulls Updated 11 months ago

Updated 11 months ago

11 months ago

6a7308d3d318 · 5.1GB

parameters7.24B

quantizationQ5_K_M

{"num_ctx":4096,"stop":["\u003c|im_start|\u003e","\u003c|im_end|\u003e"]}

<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi

Readme

CLI

ollama run ifioravanti/openhermes2.5-neural-chat

API

Example:

curl -X POST http://localhost:11434/api/generate -d '{ 
  "model": "openhermes2.5-neural-chat",
  "prompt": "Here is a story about llamas eating grass"
 }'

Memory requirements

7b models generally require at least 8GB of RAM

References