microai / suzume-llama3

This Suzume 8B, a Japanese finetune of Llama 3.

8B

131 Pulls Updated 3 months ago

3 months ago

33d8da857e71 · 4.9GB

model
llama
·
8.03B
·
Q4_K_M
template
{{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|> {{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|> {{ .Response }}<|eot_id|>
params
{"num_ctx":4096,"num_predict":1024,"repeat_last_n":256,"repeat_penalty":1.2,"temperature":0.7,"top_k":40,"top_p":0.9}

Readme

https://huggingface.co/lightblue/suzume-llama-3-8B-japanese

This Suzume 8B, a Japanese finetune of Llama 3.

Llama 3 has exhibited excellent performance on many English language benchmarks. However, it also seemingly been finetuned on mostly English data, meaning that it will respond in English, even if prompted in Japanese.

We have fine-tuned Llama 3 on more than 3,000 Japanese conversations meaning that this model has the intelligence of Llama 3 but has the added ability to chat in Japanese.

Please feel free to comment on this model and give us feedback in the Community tab!

We will release a paper in the future describing how we made the training data, the model, and the evaluations we have conducted of it.