19 Pulls Updated 11 months ago
Updated 11 months ago
11 months ago
8ca5f88a32d1 · 34GB
model
archllama
·
parameters60.8B
·
quantizationQ4_0
34GB
params
{
"num_ctx": 32768,
"stop": [
"<|im_start|>",
"<|im_end|>"
]
}
75B
template
<|im_start|>system
{{ .System }}<|im_end|>
<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assi
106B
Readme
CLI
ollama run ifioravanti/bagel-hermes:2x34b-q6_k
API
Example:
curl -X POST http://localhost:11434/api/generate -d '{
"model": "ifioravanti/bagel-hermes:2x34b-q6_k",
"prompt": "Here is a story about llamas eating grass"
}'