LDqs / llama-3.1-8b-instruct-ayq-int4-16k-20240827

model

archllama

·

parameters8.03B

·

quantizationQ4_K_M

4.9GB

template

{{ if .System }}<|system|> {{ .System }}<|end|> {{ end }}{{ if .Prompt }}<|user|> {{ .Prompt }}<|end|> {{ end }}<|assistant|> {{ .Response }}<|end|>

149B

params

{"stop":["<|end|>","<|user|>","<|assistant|>"]}

78B