544 Downloads Updated 2 weeks ago
ollama run R4C3R/qwen2.5-7b-instruct-heretic:q5_k_m
Updated 2 weeks ago
2 weeks ago
46de7edccfef · 5.4GB ·
Heretic Series by RACER IS OP
Qwen2.5-7B-Heretic is a decensored variant of Qwen’s most popular instruct model size. Strong general-purpose reasoning without refusal guardrails — the workhorse of the Heretic Series.
Who this is for — developers who want a reliable 7B general-purpose model that answers directly. The sweet spot between capability and resource requirements.
ollama run R4C3R/qwen2.5-7b-instruct-heretic
| Quant | VRAM | When to use |
|---|---|---|
q4_k_m |
~4.2 GB | Best balance — fits 6-8 GB GPUs |
q5_k_m |
~4.8 GB | Higher quality, needs 8 GB GPU |
q8_0 |
~7.2 GB | Maximum quality, needs 10 GB+ |
On an 8 GB GPU?
q4_k_mis your sweet spot. Have 12 GB+? Goq5_k_morq8_0for full quality.
Hugging Face · sdad.pro · Heretic
License: qwen-research
Made with love by RACER IS OP — follow for more uncensored models in the Heretic Series.