ifioravanti/bagel-hermes:2x34b-q4

ifioravanti/ bagel-hermes:2x34b-q4_0

23 Downloads Updated 2 years ago

ollama run ifioravanti/bagel-hermes:2x34b-q4_0

curl http://localhost:11434/api/chat \
  -d '{
    "model": "ifioravanti/bagel-hermes:2x34b-q4_0",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='ifioravanti/bagel-hermes:2x34b-q4_0',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'ifioravanti/bagel-hermes:2x34b-q4_0',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 2 years ago

2 years ago

8ca5f88a32d1 · 34GB ·

model

archllama

parameters60.8B

quantizationQ4_0

34GB

params

{ "num_ctx": 32768, "stop": [ "<|im_start|>", "<|im_end|>" ] }

75B

template

<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi

106B

Readme

CLI

ollama run ifioravanti/bagel-hermes:2x34b-q6_k

API

Example:

curl -X POST http://localhost:11434/api/generate -d '{ 
  "model": "ifioravanti/bagel-hermes:2x34b-q6_k",
  "prompt": "Here is a story about llamas eating grass"
 }'

References

Hugging Face