technobyte/
Llama-3.3-70B-Abliterated:IQ2_XS

2,500 9 months ago

(for 24 GB) Uncensored L3.3 70B, IQ2_XXS and IQ2_XS version

tools

9 months ago

926f01a2a0b9 · 21GB

model
llama
·
70.6B
·
IQ2_XS
params
{ "num_ctx": 4096, "stop": [ "<|start_header_id|>", "<|end_header_id|>",
template
{{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|> {{- if .System }} {{ .System }

Readme

Llama 3.3 70B Abliterated (Uncensored) for 24 GB VRAM

IQ2_XS: Higher quality, 4096 context

IQ2_XXS: Lower quality 6144 context