eas/omnibeagle:iq3

eas/ omnibeagle:iq3_xxs

51 Downloads Updated 1 year ago

Omnibeagel with 4K context

ollama run eas/omnibeagle:iq3_xxs

curl http://localhost:11434/api/chat \
  -d '{
    "model": "eas/omnibeagle:iq3_xxs",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='eas/omnibeagle:iq3_xxs',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'eas/omnibeagle:iq3_xxs',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 1 year ago

1 year ago

444539881f99 · 3.0GB ·

model

archllama

parameters7.24B

quantizationIQ3_XXS

3.0GB

params

{ "num_ctx": 4096, "stop": [ "<|im_end|>", "|im_end|>", "<|im_start|

116B

template

<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi

105B

Readme

From mlabonne/OmniBeagle-7B

OmniBeagle-7B is a merge of the following models using LazyMergekit:

shadowml/BeagleSempra-7B shadowml/BeagSake-7B shadowml/WestBeagle-7B