Meta-Llama-3-12B-Instruct is a depth upscaling merge of llama3-8b from M. Labonne
274 Pulls Updated 5 months ago
Updated 6 months ago
6 months ago
885781ecc54c · 8.0GB
model
archllama
·
parameters11.5B
·
quantizationQ5_K_S
8.0GB
params
{"num_keep":24,"stop":["\u003c|start_header_id|\u003e","\u003c|end_header_id|\u003e","\u003c|eot_id|
110B
template
{{ if .System }}<|start_header_id|>system<|end_header_id|>
{{ .System }}<|eot_id|>{{ end }}{{ if
260B
Readme
Meta-Llama-3-12B-Instruct is a depth upscaling merge of llama3-8b from M. Labonne
Quantized with imatrix using groups_merged.txt