ifioravanti / neuralbeagle14-7b

This is the model for neuralbeagle14-7b

7b

524 Pulls Updated 10 months ago

Updated 10 months ago

10 months ago

4c97a16017ac · 5.9GB

parameters7.24B

quantizationQ6_K

{"num_ctx":8192,"stop":["\u003c|im_start","\u003c|im_end","|im_start","|im_end"]}

<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi

Readme

CLI

ollama run ifioravanti/neuralbeagle14-7b

API

Example:

curl -X POST http://localhost:11434/api/generate -d '{ 
  "model": "ifioravanti/neuralbeagle14-7b",
  "prompt": "Here is a story about llamas eating grass"
 }'

Memory requirements

7b models generally require at least 8GB of RAM

References