krith/
meta-llama-3.1-8b-instruct:IQ2_XXS

192 1 year ago

I-quants for meta-llama-3.1-8b-instruct

tools

1 year ago

7e31dfd808a9 · 2.4GB ·

model
llama
·
8.03B
·
IQ2_XXS
template
{{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|> {{- if .System }} {{ .System }
license
LLAMA 3.1 COMMUNITY LICENSE AGREEMENT Llama 3.1 Version Release Date: July 23, 2024 “Agreement”
params
{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"

Readme

Created using GGUF files from https://huggingface.co/ThomasBaruzier/Meta-Llama-3.1-8B-Instruct-GGUF