krith/
llama-3.3-70b-instruct:IQ2_M

418 8 months ago

I-quants for llama-3.3-70b-instruct

tools

8 months ago

17f6a9674949 · 24GB

model
llama
·
70.6B
·
IQ2_M
license
LLAMA 3.3 COMMUNITY LICENSE AGREEMENT Llama 3.3 Version Release Date: December 6, 2024 “Agreementâ
template
{{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|> {{- if .System }} {{ .System }
params
{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"

Readme

Created using GGUF files from https://huggingface.co/ThomasBaruzier/Llama-3.3-70B-Instruct-GGUF