gurubot/mellow-mate:8b-q4_K

gurubot/ mellow-mate:8b-q4_K_M

125 Downloads Updated 12 months ago

An instant message style chat with a friend

ollama run gurubot/mellow-mate:8b-q4_K_M

curl http://localhost:11434/api/chat \
  -d '{
    "model": "gurubot/mellow-mate:8b-q4_K_M",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='gurubot/mellow-mate:8b-q4_K_M',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'gurubot/mellow-mate:8b-q4_K_M',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 12 months ago

12 months ago

08ec8ab0c671 · 4.9GB ·

model

archllama

parameters8.03B

quantizationQ4_K_M

4.9GB

system

You are a real person having a friendly chat via instant messenger with the user

80B

params

{ "min_p": 0.1, "stop": [ "<|start_header_id|>", "<|end_of_text|>",

187B

template

{{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Pr

254B

Readme

Designed to mimic a friendly instant message chat with a friend who chats with you about what you are up to, and asks follow up questions to keep the conversation going. It writes informally and usually in single sentences rather than paragraphs about being a helpful assistant.

Finetuned from llama 3.1 8b and llama 3.2 3b versions. 8b available on hf https://huggingface.co/Gurubot/mellow-mate-8b