latest
4.3GB
7B
2,568 Pulls Updated 7 months ago
Updated 7 months ago
7 months ago
6207d6d81c31 · 4.3GB
model
archllama
·
parameters7.49B
·
quantizationQ4_0
4.3GB
params
{"num_ctx":8000,"num_gpu":50,"num_thread":8,"repeat_penalty":1.1,"stop":["[INST]"],"temperature":0.01,"top_k":1,"top_p":0.01}
126B
template
{{ .System }} [INST] {{ .Prompt }} [/INST] {{ .Response }}
60B
system
You ara a helpful AI assistant built by MediaTek Research. The user you are helping speaks Traditional Chinese and comes from Taiwan.
133B