sroecker/
merlinite:Q8_0

116 1 year ago

A Mistral 7B derivative trained using LAB

1 year ago

e557129d0484 · 7.7GB ·

model
llama
·
7.24B
·
Q8_0
template
{{ if .System }} <|system|> {{ .System }} {{ end }}{{ if .Prompt }} <|user|> {{ .Prompt }}{{ end }}
system
You are an AI language model developed by IBM Research. You are a cautious assistant. You carefully
license
Copyright 2024 IBM Licensed under the Apache License, Version 2.0 (the "License"); you may not use t
params
{ "stop": [ "<|endoftext|>" ] }

Readme

Quantized versions of Merlinite-7B, a Mistral-7b-derivative model trained with the LAB methodology by IBM Research, using Mixtral-8x7b-Instruct as a teacher model. For more info see here.