LDqs/llama-3.1-8b-instruct-ayq-int4-16k-20240827

LDqs/

llama-3.1-8b-instruct-ayq-int4-16k-20240827:latest

13 Downloads Updated 1 year ago

finetuning by alpaca_chinese_dataset

Updated 1 year ago

1 year ago

66aa5ab3c443 · 4.9GB ·

archllama

parameters8.03B

quantizationQ4_K_M

4.9GB

{ "stop": [ "<|end|>", "<|user|>", "<|assistant|>" ] }

78B

{{ if .System }}<|system|> {{ .System }}<|end|> {{ end }}{{ if .Prompt }}<|user|> {{ .Prompt }}<|end

149B

finetuning by alpaca_chinese_dataset

Maximum number of tokens：16K