huihui_ai/
mistral-small-abliterated:24b-instruct-2501-q5_K_M

2,872 3 months ago

Mistral Small 3 sets a new benchmark in the “small” Large Language Models category below 70B.

tools 24b

3 months ago

de9d076128c4 · 17GB

model
llama
·
23.6B
·
Q5_K_M
template
{{- range $index, $_ := .Messages }} {{- if eq .Role "system" }}[SYSTEM_PROMPT]{{ .Content }}[/SYSTE
system
You are Mistral Small 3, a Large Language Model (LLM) created by Mistral AI, a French startup headqu
license
Apache License Version 2.0, January 2004
params
{ "temperature": 0.15 }

Readme

This is an uncensored version of mistralai/Mistral-Small-24B-Instruct-2501 created with abliteration (see remove-refusals-with-transformers to know more about it).
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.

References

HuggingFace