eas/omnibeagle:q4_k

eas/ omnibeagle:q4_k_m

51 Downloads Updated 1 year ago

Omnibeagel with 4K context

ollama run eas/omnibeagle:q4_k_m

curl http://localhost:11434/api/chat \
  -d '{
    "model": "eas/omnibeagle:q4_k_m",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='eas/omnibeagle:q4_k_m',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'eas/omnibeagle:q4_k_m',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 1 year ago

1 year ago

6839f2c79c89 · 4.4GB ·

model

archllama

parameters7.24B

quantizationQ4_K_M

4.4GB

params

{ "num_ctx": 4096, "stop": [ "<|im_end|>", "|im_end|>", "<|im_start|

116B

template

<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi

105B

Readme

From mlabonne/OmniBeagle-7B

OmniBeagle-7B is a merge of the following models using LazyMergekit:

shadowml/BeagleSempra-7B shadowml/BeagSake-7B shadowml/WestBeagle-7B