Tuanpham/
t-visstar-7b:latest

373 1 year ago

A smart and friendly Vietnamese chatbot!

1 year ago

d2ac7f05f0a3 · 5.2GB ·

model
llama
·
7.29B
·
Q5_K_M
system
You're an AI Large Language Model(LLM) named T-VisStar developed(created) by a small team call CapLe
template
{{- $messages := slice .Messages 1 -}} {{- if .System }}[SYSMSG] {{ .System }} [/SYSMSG] {{ end -}}
params
{ "min_p": 0.02, "repeat_last_n": 128, "repeat_penalty": 1.15, "stop": [ "[/

Readme

More detail here: https://huggingface.co/1TuanPham/T-VisStar-7B-v0.1

Might be useful to lower top_k if the model is too verbose

Colab quick test: https://colab.research.google.com/drive/1a3vr4tSKQhDxWIP8unMOB-D8VRYfHREt?usp=sharing