model

archllama

·

parameters24.2B

·

quantizationQ4_K_M

15GB

params

{ "num_ctx": 8096, "stop": [ "<|im_end|>", "<|im_start|>" ], "temper

92B

template

<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi

106B