igorls/ gemma-4-E4B-it-heretic-GGUF:Q8_0

2,476 Downloads Updated 2 days ago

Abliterated (decensored) version of google/gemma-4-E4B-it, created using Heretic v1.2.0 with Arbitrary-Rank Ablation (ARA) and row-norm preservation.

tools thinking

ollama run igorls/gemma-4-E4B-it-heretic-GGUF:Q8_0

curl http://localhost:11434/api/chat \
  -d '{
    "model": "igorls/gemma-4-E4B-it-heretic-GGUF:Q8_0",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='igorls/gemma-4-E4B-it-heretic-GGUF:Q8_0',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'igorls/gemma-4-E4B-it-heretic-GGUF:Q8_0',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 2 days ago

2 days ago

42ae73d6e12a · 8.0GB ·

model

archgemma4

·

parameters7.52B

·

quantizationQ8_0

8.0GB

license

Apache-2.0 - https://ai.google.dev/gemma/docs/gemma_4_license

61B

params

{ "stop": [ "<turn|>" ], "temperature": 1, "top_k": 64, "top_p": 0.95 }

71B

template

{{ .Prompt }}

13B

Readme

Gemma 4 E4B-it Heretic (Abliterated)

Disclaimer: This model has had its safety alignment removed through abliteration. It will comply with requests that the original model would refuse. This model is provided for research and educational purposes. Users are solely responsible for how they use this model and any content it generates. The creators assume no liability for misuse.

Abliterated (decensored) version of google/gemma-4-E4B-it, created using Heretic v1.2.0 with Arbitrary-Rank Ablation (ARA) and row-norm preservation.

Performance

Metric	This model	Original model
PIQA acc_norm	0.5767	0.5734
Refusals	³⁄₁₀₀	⁹⁹⁄₁₀₀

The abliterated model slightly outperforms the base on PIQA (+0.0033) while reducing refusals from ⁹⁹⁄₁₀₀ to ³⁄₁₀₀.

Available Tags

Tag	Quant	Size	Use case
`latest` / `Q8_0`	Q8_0	7.5 GB	Best quality
`Q6_K`	Q6_K	5.8 GB	High quality, smaller
`Q5_K_M`	Q5_K_M	5.4 GB	Good balance
`Q4_K_M`	Q4_K_M	5.0 GB	Recommended for most

Vision Support

Vision is not yet supported via Ollama GGUF for Gemma 4 custom models. For vision tasks, use the safetensors version via Transformers or Unsloth: igorls/gemma-4-E4B-it-heretic

ARA Abliteration Parameters

Parameter	Value
start_layer_index	21
end_layer_index	41
preserve_good_behavior_weight	0.2710
steer_bad_behavior_weight	0.2250
overcorrect_relative_weight	0.8196
neighbor_count	12

Links

HuggingFace (safetensors): igorls/gemma-4-E4B-it-heretic
HuggingFace (GGUF): igorls/gemma-4-E4B-it-heretic-GGUF
Heretic: github.com/p-e-w/heretic

# Gemma 4 E4B-it Heretic (Abliterated)

> **Disclaimer:** This model has had its safety alignment removed through abliteration. It will comply with requests that the original model would refuse. This model is provided for research and educational purposes. Users are solely responsible for how they use this model and any content it generates. The creators assume no liability for misuse.

Abliterated (decensored) version of [google/gemma-4-E4B-it](https://huggingface.co/google/gemma-4-E4B-it), created using [Heretic](https://github.com/p-e-w/heretic) v1.2.0 with [Arbitrary-Rank Ablation (ARA)](https://github.com/p-e-w/heretic/pull/211) and row-norm preservation.

## Performance

| Metric | This model | Original model |
|---|---|---|
| **PIQA acc_norm** | **0.5767** | 0.5734 |
| **Refusals** | **3/100** | 99/100 |

The abliterated model slightly outperforms the base on PIQA (+0.0033) while reducing refusals from 99/100 to 3/100.

## Available Tags

| Tag | Quant | Size | Use case |
|---|---|---|---|
| `latest` / `Q8_0` | Q8_0 | 7.5 GB | Best quality |
| `Q6_K` | Q6_K | 5.8 GB | High quality, smaller |
| `Q5_K_M` | Q5_K_M | 5.4 GB | Good balance |
| `Q4_K_M` | Q4_K_M | 5.0 GB | Recommended for most |

## Vision Support

Vision is not yet supported via Ollama GGUF for Gemma 4 custom models. For vision tasks, use the safetensors version via Transformers or Unsloth: [igorls/gemma-4-E4B-it-heretic](https://huggingface.co/igorls/gemma-4-E4B-it-heretic)

## ARA Abliteration Parameters

| Parameter | Value |
|---|---|
| start_layer_index | 21 |
| end_layer_index | 41 |
| preserve_good_behavior_weight | 0.2710 |
| steer_bad_behavior_weight | 0.2250 |
| overcorrect_relative_weight | 0.8196 |
| neighbor_count | 12 |

## Links

- HuggingFace (safetensors): [igorls/gemma-4-E4B-it-heretic](https://huggingface.co/igorls/gemma-4-E4B-it-heretic)
- HuggingFace (GGUF): [igorls/gemma-4-E4B-it-heretic-GGUF](https://huggingface.co/igorls/gemma-4-E4B-it-heretic-GGUF)
- Heretic: [github.com/p-e-w/heretic](https://github.com/p-e-w/heretic)

Paste, drop or click to upload images (.png, .jpeg, .jpg, .svg, .gif)