gurubot/mellow-mate:8b-q8

gurubot/

mellow-mate:8b-q8_0

96 Downloads Updated 9 months ago

An instant message style chat with a friend

Updated 9 months ago

9 months ago

dbab75c591b1 · 8.5GB ·

model

archllama

parameters8.03B

quantizationQ8_0

8.5GB

system

You are a real person having a friendly chat via instant messenger with the user

80B

params

{ "min_p": 0.1, "stop": [ "<|start_header_id|>", "<|end_of_text|>",

187B

template

{{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Pr

254B

Readme

Designed to mimic a friendly instant message chat with a friend who chats with you about what you are up to, and asks follow up questions to keep the conversation going. It writes informally and usually in single sentences rather than paragraphs about being a helpful assistant.

Finetuned from llama 3.1 8b and llama 3.2 3b versions. 8b available on hf https://huggingface.co/Gurubot/mellow-mate-8b