technobyte/
Llama-3.3-70B-Abliterated:IQ2_XXS

2,500 9 months ago

(for 24 GB) Uncensored L3.3 70B, IQ2_XXS and IQ2_XS version

tools

9 months ago

2b48a7eb95ee · 19GB

model
llama
·
70.6B
·
IQ2_XXS
params
{ "num_ctx": 6144, "stop": [ "<|start_header_id|>", "<|end_header_id|>",
template
{{- if or .System .Tools }}<|start_header_id|>system<|end_header_id|> {{- if .System }} {{ .System }

Readme

Llama 3.3 70B Abliterated (Uncensored) for 24 GB VRAM

IQ2_XS: Higher quality, 4096 context

IQ2_XXS: Lower quality 6144 context