ifioravanti / neutrixomnibe-dpo

NeuTrixOmniBe-DPO is a merge of the NeuralTrix-7B-dpo and OmniBeagleSquaredMBX-v3-7B-v2

7B

66 Pulls Updated 4 months ago

4 months ago

c946c072a969 · 4.1GB

model
llama
·
7.24B
·
Q4_0
template
### System: {{ .System }} ### User: {{ .Prompt }} ### Assistant:
params
{"num_ctx":32768,"stop":["</s>","<|im_start|>","<|im_end|>"]}

Readme

NOT READY FOR THE PRIME TIME!

I’m trying to figure out the right teamplate here, stay tuned!

image

CLI

ollama run ifioravanti/neutrixomnibe-dpo

API

Example:

curl -X POST http://localhost:11434/api/generate -d '{ 
  "model": "ifioravanti/neutrixomnibe-dpo",
  "prompt": "Here is a story about llamas eating grass"
 }'

Memory requirements

  • 7b models generally require at least 8GB of RAM

References

Hugging Face