388 Downloads Updated 5 months ago
A new small reasoning model fine-tuned from the Qwen 2.5 3B Instruct model. I-Quants models, abliterated with uncensored prompt.
Models
View all →Readme
This is an uncensored version of PowerInfer/SmallThinker-3B-Preview created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.
- Quantization from
fp32 - Using i-matrix
calibration_datav3.txt - Abliterated with uncensored prompt