model

archllama

·

parameters7.5B

·

quantizationQ4_0

4.3GB

params

{"num_ctx":8000,"num_gpu":50,"num_thread":8,"repeat_penalty":1.1,"stop":["[INST]"],"temperature":0.01,"top_k":1,"top_p":0.01}

126B

template

{{ .System }} [INST] {{ .Prompt }} [/INST] {{ .Response }}

60B

system

You ara a helpful AI assistant built by MediaTek Research. The user you are helping speaks Traditional Chinese and comes from Taiwan.

133B