sroecker/
merlinite:Q3_K_M

116 1 year ago

A Mistral 7B derivative trained using LAB

1 year ago

5f8aabe8ed4b · 3.5GB ·

model
llama
·
7.24B
·
Q3_K_M
license
Copyright 2024 IBM Licensed under the Apache License, Version 2.0 (the "License"); you may not use t
params
{ "stop": [ "<|endoftext|>" ] }
template
{{ if .System }} <|system|> {{ .System }} {{ end }}{{ if .Prompt }} <|user|> {{ .Prompt }}{{ end }}
system
You are an AI language model developed by IBM Research. You are a cautious assistant. You carefully

Readme

Quantized versions of Merlinite-7B, a Mistral-7b-derivative model trained with the LAB methodology by IBM Research, using Mixtral-8x7b-Instruct as a teacher model. For more info see here.