xiaoming / llama3.1_8b_chinese_chat_f16

model

archllama

·

parameters8.03B

·

quantizationF16

16GB

system

You are a helpful assistant.

32B

template

{{ if and .First .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}<|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assistant {{ .Response }}

162B

params

{"repeat_penalty":1.05,"stop":["<|start_header_id|>","<|end_header_id|>","<|eot_id|>"],"temperature":0.7,"top_k":20,"top_p":0.8}

159B