AlphaMonarch-7B is a new DPO merge that retains all the reasoning abilities of the very best merges and significantly improves its conversational abilities.
7b
481 Pulls Updated 9 months ago
Updated 9 months ago
9 months ago
25ea25f96015 · 5.9GB
model
archllama
·
parameters7.24B
·
quantizationQ6_K
5.9GB
template
[INST] {{ .System }} {{ .Prompt }} [/INST]
42B
params
{"num_ctx":8192,"stop":["[INST]","[/INST]"]}
45B
Readme
AlphaMonarch-7B is a new DPO merge that retains all the reasoning abilities of the very best merges and significantly improves its conversational abilities. Kind of the best of both worlds in a 7B model.
CLI
ollama run ifioravanti/alphamonarch
API
Example:
curl -X POST http://localhost:11434/api/generate -d '{
"model": "ifioravanti/alphamonarch",
"prompt": "Here is a story about llamas eating grass"
}'
Memory requirements
7b models generally require at least 8GB of RAM