huihui_ai/
granite3.2-abliterated:latest

1,555 8 months ago

Granite-3.2 is a family of long-context AI models from IBM Granite fine-tuned for thinking capabilities.

tools 2b 8b

8 months ago

52c897b14c7e · 4.9GB ·

model
granite
·
8.17B
·
Q4_K_M
template
{{- /* ------ MESSAGE PARSING ------ */}} {{- /* Declare the prompt structure variables to be filled
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US

Readme

This is an uncensored version of ibm-granite/granite-3.2 created with abliteration (see remove-refusals-with-transformers to know more about it).
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.

References

HuggingFace

Donation

If you like it, please click ‘like’ and follow us for more updates.
You can follow x.com/support_huihui to get the latest model information from huihui.ai.

Your donation helps us continue our further development and improvement, a cup of coffee can do it.
  • bitcoin:
  bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge