ifioravanti/neuralbeagle14-7b:7b-q8

ifioravanti/ neuralbeagle14-7b:7b-q8_0

844 Downloads Updated 2 years ago

This is the model for neuralbeagle14-7b

ollama run ifioravanti/neuralbeagle14-7b:7b-q8_0

curl http://localhost:11434/api/chat \
  -d '{
    "model": "ifioravanti/neuralbeagle14-7b:7b-q8_0",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='ifioravanti/neuralbeagle14-7b:7b-q8_0',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'ifioravanti/neuralbeagle14-7b:7b-q8_0',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 2 years ago

2 years ago

35681f4b3e06 · 7.7GB ·

model

archllama

parameters7.24B

quantizationQ8_0

7.7GB

params

{ "num_ctx": 8192, "stop": [ "<|im_start", "<|im_end", "|im_start",

82B

template

<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi

106B

Readme

CLI

ollama run ifioravanti/neuralbeagle14-7b

API

Example:

curl -X POST http://localhost:11434/api/generate -d '{ 
  "model": "ifioravanti/neuralbeagle14-7b",
  "prompt": "Here is a story about llamas eating grass"
 }'

Memory requirements

7b models generally require at least 8GB of RAM

References

Hugging Face