Tuanpham/t-visstar-7b

Tuanpham/

t-visstar-7b

373 Downloads Updated 1 year ago

A smart and friendly Vietnamese chatbot!

Name

3 models

Size

Context

Input

t-visstar-7b:latest

5.2GB · 32K context window · Text · 1 year ago

t-visstar-7b:latest

5.2GB

32K

Text

t-visstar-7b:iq4_xs-imat

3.9GB · 32K context window · Text · 1 year ago

t-visstar-7b:iq4_xs-imat

3.9GB

32K

Text

t-visstar-7b:q4_k_m-imat

4.4GB · 32K context window · Text · 1 year ago

t-visstar-7b:q4_k_m-imat

4.4GB

32K

Text

Might be useful to lower top_k if the model is too verbose

Colab quick test: https://colab.research.google.com/drive/1a3vr4tSKQhDxWIP8unMOB-D8VRYfHREt?usp=sharing