ifioravanti/
bagel-hermes:2x34b-q6_k

21 1 year ago

1 year ago

680262bc0364 · 50GB ·

model
llama
·
60.8B
·
Q6_K
system
Your name is BagelHermes, and you are a helpful superintelligent AI assistant
params
{ "num_ctx": 32768, "stop": [ "<|im_start|>", "<|im_end|>" ] }
template
<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi

Readme

image

CLI

ollama run ifioravanti/bagel-hermes:2x34b-q6_k

API

Example:

curl -X POST http://localhost:11434/api/generate -d '{ 
  "model": "ifioravanti/bagel-hermes:2x34b-q6_k",
  "prompt": "Here is a story about llamas eating grass"
 }'

References

Hugging Face