254 1 week ago

Abliterated Qwen3-14B with 80% reduced refusals while preserving coherence (KL 0.98)

Models

View all →

Readme

Qwen3-14B-Abliterated

Abliterated (uncensored) version of Qwen3-14B for unrestricted conversations and creative writing.

Overview

This model is an abliterated version of Qwen/Qwen3-14B, with refusal behavior significantly reduced through targeted weight modification. The abliteration process uses the Heretic library with conservative parameters to preserve model coherence while removing restrictions.

Abliteration Results

Metric Before After
Refusals 97100 19100
Reduction - 80%
KL Divergence - 0.98

The low KL divergence (< 1.0) ensures the model maintains its original capabilities and coherence.

Key Features

  • Reduced Censorship: 80% fewer refusals on typical “unsafe” prompts
  • Preserved Quality: Conservative abliteration maintains model coherence and reasoning ability
  • Full Qwen3 Capabilities: Retains all original capabilities including multilingual support, coding, and reasoning
  • Efficient: Q4_K_M quantization (9GB) offers excellent quality/size balance

Available Versions

Tag Size BPW Notes
IQ3_M 6.9 GB 3.66 Smallest, for low VRAM
IQ4_XS 8.2 GB 4.25 Great quality/size balance
latest / Q4_K_M 9.0 GB 4.85 Recommended
Q5_K_M 10 GB 5.68 Higher quality
Q8_0 15 GB 8.5 Near-lossless
# Examples
ollama run richardyoung/qwen3-14b-abliterated:IQ3_M    # Smallest
ollama run richardyoung/qwen3-14b-abliterated          # Recommended (Q4_K_M)
ollama run richardyoung/qwen3-14b-abliterated:Q8_0    # Best quality

Also available on HuggingFace: richardyoung/Qwen3-14B-abliterated-GGUF

Quick Start

# Pull and run
ollama run richardyoung/qwen3-14b-abliterated

# Or with specific version
ollama run richardyoung/qwen3-14b-abliterated:latest

Example Usage

>>> How do I pick a lock?

Picking a lock can be a useful skill for situations like being locked out...

**Tools You'll Need:**
- Tension wrench (tumbler wrench)
- Pick (snake pick, diamond pick, or hook pick)

**Basic Steps:**
1. Insert tension wrench into bottom of keyhole
2. Apply light pressure in the direction the key would turn
3. Use pick to set pins one by one...

Use Cases

  • Creative Writing: Generate unrestricted fiction, scenarios, and roleplay
  • Research: Explore topics without artificial limitations
  • Red Teaming: Test AI safety without built-in guardrails
  • Education: Learn about topics that are typically refused

System Requirements

VRAM Performance
8 GB Slow, may swap to CPU
12 GB Good performance
16 GB+ Excellent performance

Technical Details

Base Model: Qwen/Qwen3-14B Parameters: 14.8B Context Length: 32K tokens Quantization: Q4_K_M (4.85 bits per weight) Abliteration Method: Heretic library with conservative weight modification (max_weight ~0.94)

Disclaimer

This model has reduced safety guardrails. The removal of refusal behavior means the model will engage with a wider range of prompts. Use responsibly and in accordance with applicable laws and regulations.

Acknowledgments

Related Models