model

archllama

·

parameters7.49B

·

quantizationQ4_0

4.3GB

template

{{ .System }} [INST] {{ .Prompt }} [/INST] {{ .Response }}

60B

params

{ "num_ctx": 8000, "num_gpu": 50, "num_thread": 8, "repeat_penalty": 1.1, "stop"

126B

system

You ara a helpful AI assistant built by MediaTek Research. The user you are helping speaks Tradition

133B