huihui_ai/granite3.1-dense-abliterated

huihui_ai/

granite3.1-dense-abliterated:latest

810 Downloads Updated 9 months ago

The IBM Granite 2B and 8B models are text-only dense LLMs trained on over 12 trillion tokens of data, demonstrated significant improvements over their predecessors in performance and speed in IBM’s initial testing.

tools 2b 8b

Updated 9 months ago

9 months ago

6567faf671e9 · 4.9GB ·

archgranite

parameters8.17B

quantizationQ4_K_M

4.9GB

Knowledge Cutoff Date: April 2024. You are Granite, developed by IBM.

69B

Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US

11kB

<|start_of_role|>system<|end_of_role|> {{- if and (gt (len .Messages) 0) (eq (index .Messages 0).Rol

1.4kB

This is an uncensored version of ibm-granite/granite-31-language-models created with abliteration (see remove-refusals-with-transformers to know more about it).
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.