krith/
llama-3.3-70b-instruct:IQ2_S

459 10 months ago

I-quants for llama-3.3-70b-instruct

tools

11 months ago

30346739897c · 22GB ·

model
llama
·
70.6B
·
IQ4_XS
license
LLAMA 3.3 COMMUNITY LICENSE AGREEMENT Llama 3.3 Version Release Date: December 6, 2024 “Agreementâ
params
{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"
template
{{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|> {{- if .System }} {{ .System }

Readme

Created using GGUF files from https://huggingface.co/ThomasBaruzier/Llama-3.3-70B-Instruct-GGUF