huihui_ai/
mistral-small-abliterated:24b-instruct-2501-q2_K

2,742 3 months ago

Mistral Small 3 sets a new benchmark in the “small” Large Language Models category below 70B.

tools 24b

3 months ago

c756f5d2a8a6 · 8.9GB

model
llama
·
23.6B
·
Q2_K
params
{ "temperature": 0.15 }
system
You are Mistral Small 3, a Large Language Model (LLM) created by Mistral AI, a French startup headqu
template
{{- range $index, $_ := .Messages }} {{- if eq .Role "system" }}[SYSTEM_PROMPT]{{ .Content }}[/SYSTE
license
Apache License Version 2.0, January 2004

Readme

This is an uncensored version of mistralai/Mistral-Small-24B-Instruct-2501 created with abliteration (see remove-refusals-with-transformers to know more about it).
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.

References

HuggingFace