llama3.1 8B for execution only in CPU

tools

Updated 1 year ago

1 year ago

9497a3e04b1b · 4.7GB

archllama

parameters8.03B

quantizationQ4_0

4.7GB

LLAMA 3.1 COMMUNITY LICENSE AGREEMENT Llama 3.1 Version Release Date: July 23, 2024 “Agreement”

12kB

{ "num_gpu": 0, "stop": [ "<|start_header_id|>", "<|end_header_id|>",

108B

{{ if .Messages }} {{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|> {{- if .Sys

1.7kB

Readme

Personal modification of parameters to run this model easily in the CPU only.