model

archllama

·

parameters6.06B

·

quantizationF16

12GB

params

{ "mirostat": 2, "num_ctx": 4096, "num_predict": 4096, "stop": [ "<|im_end|>

106B

template

{{- if .First }} <|im_start|>system {{ .System }}<|im_end|> {{- end }} <|im_start|>user {{ .Prompt }

134B