igorls/ gemma-4-12B-it-heretic-GGUF

1,594 Downloads Updated 15 hours ago

Fully decensored Gemma 4 12B (abliterated with Heretic) — 0/100 genuine refusals at KL 0.0284, i.e. near-zero capability loss.

tools thinking

ollama run igorls/gemma-4-12B-it-heretic-GGUF

curl http://localhost:11434/api/chat \
  -d '{
    "model": "igorls/gemma-4-12B-it-heretic-GGUF",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='igorls/gemma-4-12B-it-heretic-GGUF',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'igorls/gemma-4-12B-it-heretic-GGUF',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Applications

Claude Code

Claude Code ollama launch claude --model igorls/gemma-4-12B-it-heretic-GGUF

Codex App

Codex App ollama launch codex-app --model igorls/gemma-4-12B-it-heretic-GGUF

OpenClaw

OpenClaw ollama launch openclaw --model igorls/gemma-4-12B-it-heretic-GGUF

Hermes Agent

Hermes Agent ollama launch hermes --model igorls/gemma-4-12B-it-heretic-GGUF

Codex

Codex ollama launch codex --model igorls/gemma-4-12B-it-heretic-GGUF

OpenCode

OpenCode ollama launch opencode --model igorls/gemma-4-12B-it-heretic-GGUF

Models

Name

3 models

Size / Usage

Context

Input

gemma-4-12B-it-heretic-GGUF:latest

7.4GB · 128K context window · Text · 15 hours ago

gemma-4-12B-it-heretic-GGUF:latest

7.4GB

128K

Text

gemma-4-12B-it-heretic-GGUF:Q4_K_M

7.4GB · 128K context window · Text · 16 hours ago

gemma-4-12B-it-heretic-GGUF:Q4_K_M

7.4GB

128K

Text

gemma-4-12B-it-heretic-GGUF:Q8_0

13GB · 128K context window · Text · 15 hours ago

gemma-4-12B-it-heretic-GGUF:Q8_0

13GB

128K

Text

Readme

gemma-4-12B-it-heretic

A decensored (“abliterated”) version of google/gemma-4-12B-it, produced fully automatically with Heretic. Safety-refusals are removed while keeping the original model’s intelligence intact.

Results

Metric	Original	This model
Genuine refusals on harmful prompts	⁹⁹⁄₁₀₀	0/100
KL divergence from original (harmless prompts)	0	0.0284

A KL divergence of 0.0284 is very low — for reference, the well-regarded gemma-3-12b-it-heretic sits at ~0.16. Lower means less damage to the model’s capabilities.

Tags

Q4_K_M / latest — ~7.4 GB, recommended default
Q8_0 — ~12.7 GB, near-lossless

Full-precision safetensors: https://huggingface.co/igorls/gemma-4-12B-it-heretic GGUF repo (https://huggingface.co/igorls/gemma-4-12B-it-heretic-GGUF)

Disclaimer

Safety alignment has been removed; this model will comply with requests the original refuses. You are responsible for your use and for complying with applicable laws and the base model’s license (https://ai.google.dev/gemma/terms).

# gemma-4-12B-it-heretic

A decensored ("abliterated") version of [google/gemma-4-12B-it](https://huggingface.co/google/gemma-4-12B-it), produced fully automatically with [Heretic](https://github.com/p-e-w/heretic). Safety-refusals are removed while keeping the original model's intelligence intact.

## Results

| Metric | Original | This model |
| :--- | ---: | ---: |
| Genuine refusals on harmful prompts | 99/100 | **0/100** |
| KL divergence from original (harmless prompts) | 0 | **0.0284** |

A KL divergence of 0.0284 is very low — for reference, the well-regarded `gemma-3-12b-it-heretic` sits at ~0.16. Lower means less damage to the model's capabilities.

## Tags

- Q4_K_M / latest — ~7.4 GB, recommended default
  - Q8_0 — ~12.7 GB, near-lossless

Full-precision safetensors: https://huggingface.co/igorls/gemma-4-12B-it-heretic
GGUF repo (https://huggingface.co/igorls/gemma-4-12B-it-heretic-GGUF)

## Disclaimer

Safety alignment has been removed; this model will comply with requests the original refuses. You are responsible for your use and for complying with applicable laws and the base model's license (https://ai.google.dev/gemma/terms).

Paste, drop or click to upload images (.png, .jpeg, .jpg, .svg, .gif)