rouge/

neuralstar_fusionwriter_4x7b

NeuralStar_FusionWriter_4x7b is a Mixture of Experts (MoE) made with the following models using LazyMergekit:

108 Pulls Updated 8 months ago

Updated 8 months ago

8 months ago

06d8665bf9c7 · 26GB

parameters24.2B

quantizationQ8_0

{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>",

{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user

You are a friendly and knowledgeable AI assistant. Help users to the best of your abilities by answe

Readme

Source: https://huggingface.co/OmnicromsBrain/NeuralStar_FusionWriter_4x7b

NeuralStar_FusionWriter_4x7b

NeuralStar_FusionWriter_4x7b is a Mixture of Experts (MoE) made with the following models using LazyMergekit: * mlabonne/AlphaMonarch-7B * OmnicromsBrain/Eros_Scribe-7b * SanjiWatsuki/Kunoichi-DPO-v2-7B * OmnicromsBrain/NeuralStar_Fusion-7B

⚡ Quantized Models

Special thanks to MRadermacher for the static and imatrix quantized models

.GGUF https://huggingface.co/mradermacher/NeuralStar_FusionWriter_4x7b-GGUF

IMatrix https://huggingface.co/mradermacher/NeuralStar_FusionWriter_4x7b-i1-GGUF