mw-ai/bassie-GPT

mw-ai/ bassie-GPT:latest

5 Downloads Updated 1 year ago

A small testing model based on citations of the famous serie 'Bassie en Adriaan' to learn about finetuning using QLora, source model llama-3.1:8b-instruct

ollama run mw-ai/bassie-GPT

curl http://localhost:11434/api/chat \
  -d '{
    "model": "mw-ai/bassie-GPT",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='mw-ai/bassie-GPT',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'mw-ai/bassie-GPT',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 1 year ago

1 year ago

4905815e42a0 · 4.9GB

model

archllama

parameters8.03B

quantizationQ4_K_M

4.9GB

params

{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"

96B

template

{{- range .Messages }}<|start_header_id|>{{ .Role }}<|end_header_id|> {{ .Content }}<|eot_id|> {{- e

153B

Readme

Bassie en Adriaan Citations Model

A small experimental language model fine-tuned on memorable quotes and dialogues from the famous Dutch TV series “Bassie en Adriaan”.
This project serves as a hands-on learning exercise in fine-tuning using QLoRA, with the base model being llama-3.1:8b-instruct.

The primary goals of this model are:

Testing and experimenting with PEFT - QLoRA fine-tuning .
Experimenting with domain-specific language modeling and a sml.
Asking citations about personages from the series without using RAG or adding it to the prompt.

Note: This model is purely for testing and educational purposes, and not intended for production deployment.