huihui_ai/granite3.2-abliterated

huihui_ai/ granite3.2-abliterated

2,372 Downloads Updated 11 months ago

Granite-3.2 is a family of long-context AI models from IBM Granite fine-tuned for thinking capabilities.

tools 2b 8b

ollama run huihui_ai/granite3.2-abliterated

curl http://localhost:11434/api/chat \
  -d '{
    "model": "huihui_ai/granite3.2-abliterated",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='huihui_ai/granite3.2-abliterated',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'huihui_ai/granite3.2-abliterated',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Applications

Claude Code ollama launch claude --model huihui_ai/granite3.2-abliterated

Codex ollama launch codex --model huihui_ai/granite3.2-abliterated

OpenCode ollama launch opencode --model huihui_ai/granite3.2-abliterated

OpenClaw ollama launch openclaw --model huihui_ai/granite3.2-abliterated

Models

View all →

Name

11 models

Size

Context

Input

granite3.2-abliterated:latest

4.9GB · 128K context window · Text · 11 months ago

granite3.2-abliterated:latest

4.9GB

128K

Text

granite3.2-abliterated:2b

1.5GB · 128K context window · Text · 11 months ago

granite3.2-abliterated:2b

1.5GB

128K

Text

granite3.2-abliterated:8b

latest

4.9GB · 128K context window · Text · 11 months ago

granite3.2-abliterated:8b latest

4.9GB

128K

Text

Readme

This is an uncensored version of ibm-granite/granite-3.2 created with abliteration (see remove-refusals-with-transformers to know more about it).
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.

References

HuggingFace

Donation

If you like it, please click ‘like’ and follow us for more updates.
You can follow x.com/support_huihui to get the latest model information from huihui.ai.

Your donation helps us continue our further development and improvement, a cup of coffee can do it.

bitcoin:

  bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge