llama3 8B for execution only in CPU

Updated 1 year ago

1 year ago

48444705165b · 4.7GB ·

archllama

parameters8.03B

quantizationQ4_0

4.7GB

META LLAMA 3 COMMUNITY LICENSE AGREEMENT Meta Llama 3 Version Release Date: April 18, 2024 “Agreem

12kB

{ "num_gpu": 0, "num_keep": 24, "stop": [ "<|start_header_id|>", "<|end_

122B

{{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Pr

260B

Readme

Personal modification of parameters to run this model easily in the CPU only.