Tuanpham/
t-visstar-7b:iq4_xs-imat

374 1 year ago

A smart and friendly Vietnamese chatbot!

1 year ago

a32beee6b30b · 3.9GB ·

llama
·
7.29B
·
IQ1_M
{{- $messages := slice .Messages 1 -}} {{- if .System }}[SYSMSG] {{ .System }} [/SYSMSG] {{ end -}}
{ "min_p": 0.02, "repeat_last_n": 128, "repeat_penalty": 1.15, "stop": [ "[/
You're an AI Large Language Model(LLM) named T-VisStar developed(created) by a small team call CapLe

Readme

More detail here: https://huggingface.co/1TuanPham/T-VisStar-7B-v0.1

Might be useful to lower top_k if the model is too verbose

Colab quick test: https://colab.research.google.com/drive/1a3vr4tSKQhDxWIP8unMOB-D8VRYfHREt?usp=sharing