SpeakLeash / bielik-7b-instruct-v0.1-gguf

Polish LLM - Bielik-7B-Instruct-v0.1 ~ by SpeakLeash a.k.a Spichlerz!

7B

165 Pulls Updated 8 weeks ago

8 weeks ago

879e1d63bcee · 4.1GB

model
llama
·
7.24B
·
Q4_K_S
template
[INST] <<SYS>> {{- if .System }} {{ .System }} {{ end }}<</SYS>> {{ .Prompt }} [/INST] {{ .Response }}</s><s>

Readme

Ollama-CLI

ollama run SpeakLeash/bielik-7b-instruct-v0.1-gguf
for other quants use Tags, e.g.
ollama run SpeakLeash/bielik-7b-instruct-v0.1-gguf:Q8_0

To create your own version or with specific temperature or other args use docs:
https://github.com/ollama/ollama/blob/main/docs/modelfile.md

Bielik-7B-Instruct-v0.1-GGUF

This repo contains GGUF format model files for SpeakLeash’s Bielik-7B-Instruct-v0.1.
https://huggingface.co/speakleash/Bielik-7B-Instruct-v0.1-GGUF

DISCLAIMER: Be aware that quantised models show reduced response quality and possible hallucinations!

Model description:

Developed by: SpeakLeash
Language: Polish
Model type: causal decoder-only
Quant from: Bielik-7B-Instruct-v0.1
Finetuned from: Bielik-7B-v0.1
License: CC BY NC 4.0 (non-commercial use)
Model ref: speakleash:e38140bea0d48f1218540800bbc67e89

Website: https://speakleash.org
Hugging Face: https://huggingface.co/speakleash