kaizu/
bn_chat_2:latest

14 1 year ago

Fine-tuned version of llama2-v0.1-instruct from BanglaLLM in huggingface. Quantized to 4bit -> q4_k_m using llama.cpp. Trained on 2 * T4.

1 year ago

fe73a4b5008c · 4.2GB ·

model
llama
·
6.89B
·
Q4_K_M
template
[INST]<<SYS>>{{ .System }}<</SYS>> [INST]### Instruction: {{ .Prompt }}[/INST] ### Input: ### Respon
system
নীচে একটি কাজের নির্দেশনা রয়েছে, এর স
params
{ "num_ctx": 4096, "num_predict": 128, "repeat_penalty": 1.5, "stop": [ "[IN

Readme

No readme