143 1 week ago

The model's safety alignment was removed. It can produce harmful, offensive, or illegal content — use at your own risk and only for research or educational purposes.

vision
ollama run acc100/muse-glimmer-heretic

Details

1 week ago

8a839ee649a0 · 21GB ·

muse-glimmer
·
27.9B
·
Q4_K_M
clip
·
1.92B
·
F16
{ "temperature": 1, "top_k": 64, "top_p": 0.95 }

Readme

Muse-Glimmer-30B Heretic (Q4_K_M)

An abliterated (“decensored”) version of meta-models/Muse-Glimmer-30B, created fully automatically with Heretic — directional ablation (abliteration) combined with TPE-based parameter optimization, keeping the KL divergence from the original model minimal.

Model details

  • Base model: meta-models/Muse-Glimmer-30B (30B, multimodal)
  • Method: Heretic v1.4.0 — directional ablation via LoRA adapter (trial #191), merged into the full-precision weights
  • Quantization: Q4_K_M (16.9 GB) + vision projector (clip, 1.9B)
  • Chat template: original ATEM template (tools & reasoning) embedded in the GGUF
  • Capabilities: vision, tools, thinking
  • Context length: 131072

Quality metrics

Refusals (“harmful” prompts) | 12 / 55 | KL divergence from base | ~0.06 |