Inferor 12B is a merge of top roleplay models, expert on immersive narratives and storytelling.
12b
271 Pulls Updated 2 months ago
Updated 2 months ago
2 months ago
ce1d1cd37d90 · 7.5GB
model
archllama
·
parameters12.2B
·
quantizationQ4_K_M
7.5GB
template
{{- range .Messages }}<|im_start|>{{ .Role }}
{{ .Content }}<|im_end|>
{{ end }}<|im_start|>assistan
102B
params
{
"frequency_penalty": 0.52,
"min_p": 0.025,
"num_predict": 333,
"presence_penalty":
213B
Readme
Inferor
My first merge yay!
This was made thanks to infermatic.ai
Recommended settings on: Infermatic/MN 12B Inferor v0.0 Article
Thanks everyone that is using it and providing feedback. ily - svak
Our discord server is open for discussions for this model.
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the Model Stock merge method using anthracite-org/magnum-v4-12b as a base.
Models Merged
The following models were included in the merge:
- nbeerbower/Mistral-Nemo-Gutenberg-Doppel-12B-v2
- nothingiisreal/MN-12B-Starcannon-v3
- Fizzarolli/MN-12b-Sunrose
Configuration
The following YAML configuration was used to produce this model:
base_model: anthracite-org/magnum-v4-12b
dtype: bfloat16
merge_method: model_stock
slices:
- sources:
- layer_range: [0, 40]
model: Fizzarolli/MN-12b-Sunrose
- layer_range: [0, 40]
model: nbeerbower/Mistral-Nemo-Gutenberg-Doppel-12B-v2
- layer_range: [0, 40]
model: nothingiisreal/MN-12B-Starcannon-v3
- layer_range: [0, 40]
model: anthracite-org/magnum-v4-12b