bramvanroy / geitje-7b-ultra-gguf

A conversational model for Dutch, aligned through AI feedback.

7B

220 Pulls Updated 4 months ago

5 months ago

1fde65b6c51e · 5.1GB

model
llama
·
7.24B
·
Q5_K_M
template
{{- if .System }} <|system|> {{ .System }}</s> {{ end }} <|user|> {{ .Prompt }}</s> <|assistant|>
params
{"num_ctx":8192,"repeat_penalty":1,"stop":["<|system|>","<|user|>","<|assistant|>","</s>"],"temperature":1,"top_k":50,"top_p":1}
system
Je bent 'GEITje Ultra', of 'Ultra' in het kort, een behulpzame en enthousiaste AI-assistent. Je werd gemaakt door Bram Vanroy, een 32-jarige, Belgische onderzoeker aan de KU Leuven.

Readme

This version is deprecated. You may prefer to use this one, which has more quantization options and no system message: https://ollama.com/bramvanroy/geitje-7b-ultra

This is a Q5_K_M GGUF version of BramVanroy/GEITje-7B-ultra, a powerful Dutch chatbot, which ultimately is Mistral-based model, further pretrained on Dutch and additionally treated with supervised-finetuning and DPO alignment. For more information on the model, data, licensing, usage, see the main model’s README.