ordis/
llama3:70b-instruct-8k-q4_0

11 1 year ago

With correct 8k context window length

1 year ago

3bf3c5bba970 · 40GB ·

model
llama
·
70.6B
·
Q4_0
license
META LLAMA 3 COMMUNITY LICENSE AGREEMENT Meta Llama 3 Version Release Date: April 18, 2024 “Agreem
license
META LLAMA 3 COMMUNITY LICENSE AGREEMENT Meta Llama 3 Version Release Date: April 18, 2024 “Agreem
params
{ "num_ctx": 8192, "num_keep": 24, "stop": [ "<|start_header_id|>", "<|e
template
{{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Pr

Readme

Model copied from: https://ollama.com/library/llama3