sroecker/
merlinite:latest

116 1 year ago

A Mistral 7B derivative trained using LAB

1 year ago

98cef83df9a2 · 4.4GB ·

model
llama
·
7.24B
·
Q4_K_M
template
{{ if .System }} <|system|> {{ .System }} {{ end }}{{ if .Prompt }} <|user|> {{ .Prompt }}{{ end }}
system
You are an AI language model developed by IBM Research. You are a cautious assistant. You carefully
license
Copyright 2024 IBM Licensed under the Apache License, Version 2.0 (the "License"); you may not use t
params
{ "stop": [ "<|endoftext|>" ] }

Readme

Quantized versions of Merlinite-7B, a Mistral-7b-derivative model trained with the LAB methodology by IBM Research, using Mixtral-8x7b-Instruct as a teacher model. For more info see here.