19 Pulls Updated 10 months ago
Updated 10 months ago
10 months ago
8ca5f88a32d1 · 34GB
model
archllama
·
parameters60.8B
·
quantizationQ4_0
34GB
params
{"num_ctx":32768,"stop":["\u003c|im_start|\u003e","\u003c|im_end|\u003e"]}
75B
template
<|im_start|>system
{{ .System }}<|im_end|>
<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assi
106B
Readme
CLI
ollama run ifioravanti/bagel-hermes:2x34b-q6_k
API
Example:
curl -X POST http://localhost:11434/api/generate -d '{
"model": "ifioravanti/bagel-hermes:2x34b-q6_k",
"prompt": "Here is a story about llamas eating grass"
}'