mannix/
llama3.1-storm:q3_k_l

548 1 year ago

Llama-3.1-Storm-8B outperforms both Llama-3.1-8B-Instruct and Hermes-3-Llama-3.1-8B!

tools

1 year ago

265784b407c0 · 4.3GB ·

model
llama
·
8.03B
·
Q3_K_L
template
{{ if .Messages }} {{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|> {{- if .Sys
license
LLAMA 3.1 COMMUNITY LICENSE AGREEMENT Llama 3.1 Version Release Date: July 23, 2024 “Agreement”
params
{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"

Readme

  • Quantization from fp32
  • Using i-matrix calibration_datav3.txt

🤗 Announcement Blog: https://huggingface.co/blog/akjindal53244/llama31-storm8b

Llama-3.1-Storm-8B: Improved SLM with Self-Curation + Model Merging

image.png

HuggingFace