eas/omnibeagle:q6

eas/ omnibeagle:q6_k

51 Downloads Updated 1 year ago

Omnibeagel with 4K context

ollama run eas/omnibeagle:q6_k

curl http://localhost:11434/api/chat \
  -d '{
    "model": "eas/omnibeagle:q6_k",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='eas/omnibeagle:q6_k',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'eas/omnibeagle:q6_k',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 1 year ago

1 year ago

b100f05a9bd7 · 5.9GB ·

model

archllama

parameters7.24B

quantizationQ6_K

5.9GB

params

{ "num_ctx": 4096, "stop": [ "<|im_end|>", "|im_end|>", "<|im_start|

116B

template

<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi

105B

Readme

From mlabonne/OmniBeagle-7B

OmniBeagle-7B is a merge of the following models using LazyMergekit:

shadowml/BeagleSempra-7B shadowml/BeagSake-7B shadowml/WestBeagle-7B