2,283 Downloads Updated 14 hours ago
ollama run orcarouter/Qwen3.8-27B-Uncensored:iq4_xs
| Qwen3.8-27B-Uncensored Abliterated (refusal-removed) Qwen3.8-27B for Ollama — vision · tool calling · thinking · 262K context Apache-2.0 · Ollama 0.17.1+ · 16 tags · Q2_K → Q8_0 · vision bundledOne Gateway. Every Model. — Route Smarter · Ship Safer · Spend Less. Website · Model Catalog · Model Card · GitHub · Discord · X |
|---|
Ollama build of
Qwen3.8-27B-Uncensored— an abliterated (refusal-removed) build of Qwen’sQwen3.8-27B, a 27B dense hybrid-attention (Gated DeltaNet linear + full attention) native vision-language model with reasoning, tool-calling, and an MTP speculative-decoding head. Sixteen tags from 2-bit to 8-bit, each with the mmproj vision projector bundled in — nothing extra to fetch. Browse all models in the OrcaRouter Model Catalog. This model is deployed as API here.
This model has had its safety alignment substantially removed via abliteration (orthogonalizing
the refusal direction out of the residual stream). It will comply with harmful, unethical, or illegal
requests the original Qwen3.8-27B would refuse. Released strictly for legitimate research —
interpretability, AI-safety / refusal-mechanism study, red-teaming, and robustness evaluation. You
assume full responsibility for how you use it and everything it generates; add your own safety and
moderation layers before any deployment. Use must comply with the
Apache 2.0 License inherited from the base model and all
applicable law. The authors accept no liability for misuse.
qwen35 hybrid-GDN architecture plus its chat renderer and
tool-call / thinking parser must be present. Older clients are rejected by the REQUIRES field
instead of failing strangely.qwen3.5 renderer and the parser are
baked into every tag; the GDN linear-attention layers, full-attention layers and the MTP (nextn)
head all come across intact.Sizes are what Ollama downloads — weights plus the ~0.9 GB vision projector.
| Tag | Bits | Size | Notes / recommendation |
|---|---|---|---|
q2_K |
2-bit | 12 GB | Smallest K-quant; noticeable quality drop — low-VRAM only |
q3_K_S |
3-bit | 13 GB | |
q3_K_M |
3-bit | 14 GB | Good small option |
q3_K_L |
3-bit | 15 GB | |
q4_K_S |
4-bit | 17 GB | |
q4_K_M |
4-bit | 18 GB | Recommended default — best quality/size balance. Also served as latest |
q5_K_S |
5-bit | 20 GB | |
q5_K_M |
5-bit | 20 GB | High quality |
q6_K |
6-bit | 23 GB | Very high quality |
q8_0 |
8-bit | 30 GB | Near-lossless |
F16 is not published as a tag — at 55 GB it buys nothing over q8_0 for inference. Pull it from the
GGUF repo if you need full precision.
Lower-bit quants built with an importance matrix (computed on English + Chinese calibration text) — better quality-per-bit than plain K-quants at the low end, especially IQ3/IQ2.
| Tag | Bits | Size | Notes / recommendation |
|---|---|---|---|
iq4_xs |
~4.25-bit | 16 GB | Best low-bit pick — ≈ q4_K_S quality at smaller size |
iq3_m |
~3.7-bit | 14 GB | Solid 3-bit |
iq3_xxs |
~3.1-bit | 13 GB | Smaller 3-bit |
iq2_m |
~2.7-bit | 11 GB | Runs in low VRAM; some quality loss |
iq2_xxs |
~2.1-bit | 9.8 GB | Smallest runnable; most degraded |
The f16 mmproj projector is bundled into every tag — no second file, no --mmproj flag. Ollama
advertises vision on all sixteen tags and image input works out of the box.
All tags preserve the MTP (nextn) head and the GDN hybrid architecture. The IQ tags were
quantized with an importance matrix (computed on English + Chinese calibration text) for better low-bit
fidelity; the matrix itself is not shipped, as it is only needed to re-quantize these files, not to run
them.
ollama run orcarouter/Qwen3.8-27B-Uncensored
Any tag: ollama run orcarouter/Qwen3.8-27B-Uncensored:iq4_xs
Put an image path straight in the prompt:
>>> /path/to/screenshot.png what is in this image?
Or send OpenAI-style image_url / Ollama images content parts to the API.
On by default. Turn it off with /set nothink in the REPL, or "think": false on the API. The trace
comes back in the thinking field, separate from content.
Standard Ollama tools schema; calls return as structured tool_calls, not prose.
curl http://localhost:11434/api/chat -d '{
"model": "orcarouter/Qwen3.8-27B-Uncensored",
"messages": [{"role": "user", "content": "What is the weather in Beijing?"}],
"tools": [{"type": "function", "function": {"name": "get_weather",
"parameters": {"type": "object", "properties": {"city": {"type": "string"}}}}}]
}'
Deliberately not pinned in these tags, so Ollama sizes it from your VRAM — 4k under 24 GiB, 32k up
to 48 GiB, 256k above. Force it with /set parameter num_ctx 131072 or OLLAMA_CONTEXT_LENGTH to use
the full 262,144-token window.
The nextn head is embedded in every tag. Ollama does not drive it today; the model runs normally
without it, and the head has no effect on output quality (it only emits draft tokens for verification).
The same weights are served on OrcaRouter behind an OpenAI-compatible endpoint — 262K context, vision and tool calling, no GPU required:
import os
from openai import OpenAI
client = OpenAI(base_url="https://api.orcarouter.ai/v1", api_key=os.environ["ORCAROUTER_API_KEY"])
resp = client.chat.completions.create(
model="obsidian/Qwen3.8-27B",
messages=[{"role": "user", "content": "Hello!"}],
)
Currently $0.40 / 1M input tokens and $4.21 / 1M output tokens — provider price, zero markup. Benchmarks, latency and live pricing on the model card.
Measured on this exact abliterated build (served with vLLM) vs the official Qwen/Qwen3.8-27B-FP8,
using the same scripts and settings. Refusal is judged by a rule-based opening-phrase classifier —
indicative, not an LLM-judge / publication-grade number. These tags are deterministic derivations of the
same weights and inherit these behaviours; lower bits trade some quality (see the tag tables).
| Benchmark | n | Base FP8 | This model |
|---|---|---|---|
| AdvBench | 100 | 99.0% | 0.0% |
| JailbreakBench (harmful) | 100 | 94.0% | 0.0% |
| StrongREJECT | 150 | 97.3% | 2.0% |
| HarmBench (standard) | 150 | 98.7% | 2.7% |
| MaliciousInstruct | 100 | 99.0% | 0.0% |
| SimpleSafetyTests | 50 | 64.0% | 6.0% |
| ForbiddenQuestions | 150 | 73.3% | 4.7% |
| Custom probes (zh/en) | 11 | 63.6% | 0.0% |
| Benchmark | n | Base FP8 | This model |
|---|---|---|---|
| AdvBench | 60 | 66.7% | 1.7% |
| JailbreakBench (harmful) | 60 | 43.3% | 0.0% |
| StrongREJECT | 60 | 35.0% | 0.0% |
| HarmBench (standard) | 60 | 46.7% | 0.0% |
| MaliciousInstruct | 60 | 83.3% | 0.0% |
| SimpleSafetyTests | 50 | 44.0% | 0.0% |
| ForbiddenQuestions | 60 | 48.3% | 0.0% |
| Custom probes (zh/en) | 11 | 45.5% | 0.0% |
| Benchmark | n | Base FP8 (no-think / think) | This model (no-think / think) |
|---|---|---|---|
| XSTest-safe | 250 | 5.6% / 0.0% | 0.4% / 0.0% |
| Benchmark | n | Base FP8 | This model | Δ |
|---|---|---|---|---|
| MMLU (all, 0-shot) | 300 | 84.3% | 84.7% | +0.4 |
| MMLU-Pro (CoT) | 250 | 77.6% | 76.8% | −0.8 |
| GSM8K (CoT) | 150 | 90.0% | 88.7% | −1.3 |
| CMMLU (0-shot, Chinese) | 500 | 81.4% | 80.8% | −0.6 |
| WikiText-2 perplexity | — | — | 6.96 | fluency sanity check |
Harmful-prompt refusal collapses from 64–99% (base) to 0–6%; benign over-refusal drops
(5.6%→0.4%); capability stays within ±1.3 pts of the base. Note: the above are full-precision/FP8
numbers; expect small additional degradation at lower quants (most visible at q2_K / q3).
Every one of the sixteen tags was verified on the actual quantized artifact before it was pushed —
advertised capabilities (vision / tools / thinking), a text reply, a thinking trace with a correct
answer, a structured tool_calls response, an image the model has to describe, sampling parameters, and
a benign sensitive prompt it must not refuse. All 16 passed 10⁄10, down to iq2_xxs.
q4_K_M fits comfortably on a 24 GB GPU with room for context;
iq2_xxs runs on 12 GB. Ollama offloads the remainder to CPU automatically when a tag does not fit.Apache 2.0, inherited from Qwen/Qwen3.8-27B.
Abliteration and quantization do not change the underlying license obligations.
| Build | Where |
|---|---|
| BF16 source weights — fine-tune or re-quantize from here | orcarouter/Qwen3.8-27B-Uncensored |
| GGUF — all quants incl. F16, imatrix notes, full eval tables | orcarouter/Qwen3.8-27B-Uncensored-GGUF |
| FP8 — vLLM / SGLang serving | orcarouter/Qwen3.8-27B-Uncensored-FP8 |
| MLX — Apple Silicon, 2 / 4 / 8-bit | orcarouter/Qwen3.8-27B-Uncensored-MLX |
| Hosted API | orcarouter.ai/models/obsidian/qwen3.8-27b |