1,753 17 hours ago

Fully decensored Gemma 4 12B (abliterated with Heretic) — 0/100 genuine refusals at KL 0.0284, i.e. near-zero capability loss.

tools thinking
ollama run igorls/gemma-4-12B-it-heretic-GGUF

Details

17 hours ago

39e061f35bcc · 7.4GB ·

gemma4
·
11.9B
·
Q4_K_M
{ "stop": [ "<turn|>" ] }

Readme

gemma-4-12B-it-heretic

A decensored (“abliterated”) version of google/gemma-4-12B-it, produced fully automatically with Heretic. Safety-refusals are removed while keeping the original model’s intelligence intact.

Results

Metric Original This model
Genuine refusals on harmful prompts 99100 0/100
KL divergence from original (harmless prompts) 0 0.0284

A KL divergence of 0.0284 is very low — for reference, the well-regarded gemma-3-12b-it-heretic sits at ~0.16. Lower means less damage to the model’s capabilities.

Tags

  • Q4_K_M / latest — ~7.4 GB, recommended default
  • Q8_0 — ~12.7 GB, near-lossless

Full-precision safetensors: https://huggingface.co/igorls/gemma-4-12B-it-heretic GGUF repo (https://huggingface.co/igorls/gemma-4-12B-it-heretic-GGUF)

Disclaimer

Safety alignment has been removed; this model will comply with requests the original refuses. You are responsible for your use and for complying with applicable laws and the base model’s license (https://ai.google.dev/gemma/terms).