mannix/
qwq-32b-abilterated

1,323 8 months ago

QwQ is an experimental research model focused on advancing AI reasoning capabilities. Abliterated with uncensored prompt, i-matrix quants.

tools

Models

View all →

17 models

qwq-32b-abilterated:latest

19GB · 32K context window · Text · 8 months ago

Readme

  • Quantization from fp32
  • Using i-matrix calibration_datav3.txt
  • Uncensored system prompt

This is an uncensored version of Qwen/QwQ-32B-Preview created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.

References

HuggingFace