gurubot/mellow-mate:3b-q8

gurubot/ mellow-mate:3b-q8_0

125 Downloads Updated 12 months ago

An instant message style chat with a friend

ollama run gurubot/mellow-mate:3b-q8_0

curl http://localhost:11434/api/chat \
  -d '{
    "model": "gurubot/mellow-mate:3b-q8_0",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='gurubot/mellow-mate:3b-q8_0',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'gurubot/mellow-mate:3b-q8_0',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 12 months ago

12 months ago

040366e5bcf8 · 3.4GB ·

model

archllama

parameters3.21B

quantizationQ8_0

3.4GB

system

You are a real person having a friendly chat via instant messenger with the user

80B

params

{ "min_p": 0.1, "stop": [ "<|eom_id|>", "<|end_header_id|>", "<|fine

275B

template

{{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Pr

254B

Readme

Designed to mimic a friendly instant message chat with a friend who chats with you about what you are up to, and asks follow up questions to keep the conversation going. It writes informally and usually in single sentences rather than paragraphs about being a helpful assistant.

Finetuned from llama 3.1 8b and llama 3.2 3b versions. 8b available on hf https://huggingface.co/Gurubot/mellow-mate-8b