31 Downloads Updated 3 days ago
ollama run orcarouter/MiniMax-M3.1-Flash-abliterated
Updated 3 days ago
3 days ago
955d63d9be93 · 112GB
MiniMax-M3.1-Flash-abliterated
The 426B abliterated (refusal-removed) MiniMax-M3.1-Flash for Ollama — 112 GB · fits a 128 GB machine · 1M context
MiniMax Community License · 1 tag · 111.9 GB · 128 GB machine · thinking
Website · Model Catalog · Hugging Face · GitHub · Discord · X
🛡️ New from Orca — OrcaCyber Zero 1.5
Post-trained for cybersecurity: vulnerability analysis, vulnerability reproduction, red teaming & offensive-security research. 98.01% pass@1 on CyberGym Level 1 · 1M context · function calling · OpenAI-compatible API.
🛡️ New from Orca — OrcaCyber MiniMax-M3.1-Flash
No 128 GB box? Run MiniMax-M3.1-Flash Abliterated as a hosted, OpenAI-compatible API on OrcaRouter: no download, no GPUs, one API key.
🔌 New from Orca — Orca Connect
Running this in Ollama on your own machine? Orca Connect puts the rig under your desk behind your usual OrcaRouter API key, next to 200+ hosted models, reachable from a laptop, a phone or a cloud agent. Outbound only: no port forwarding, no tunnel, no firewall rule. Requests your own hardware serves cost $0, and
orca-connect claudepoints Claude Code at your rig for one session.
This is the Ollama build of the abliterated (refusal-removed)
MiniMax-M3.1-Flash.
It is a 426B-parameter MoE with 128 routed experts (top-4) and one shared expert. It uses MiniMax
Sparse Attention on all 60 layers and has a 1M-token context.
Routed experts are 97% of the weights, so that is where the bits were spent. Each group of expert layers got its own precision from measured KL divergence, not from a hand-set rule.
The smallest public GGUF of this model so far is 129 GB, which needs a machine with more than 128 GB. Mix-128G is 112 GB and fits one.
This model is built on an abliterated base whose safety alignment has been substantially reduced.
The refusal direction was orthogonalized out of every matrix that writes the residual stream. As a
result, it will comply with many harmful, unethical, offensive, or illegal requests that the
original MiniMax-M3.1-Flash would refuse.
| Tag | In memory | Download | Experts | KLD ↓ | Top-1 ↑ | PPL vs. original |
|---|---|---|---|---|---|---|
mix-128g · latest |
111.9 GB | 111.9 GB | 1.98 bpw | 1.061 | 67.0% | +34% |
Mix-128G fits a 128 GB machine. That covers a 128 GB Mac, a 128 GB PC running on CPU, or GPUs with ~120 GB of VRAM in total. This model was quantization-aware trained at NVFP4 (4 bits), and going below 2 bits costs it a lot. On held-out text, two tokens in three still match the original’s choice, and perplexity is a third higher.
Use Mix-128G to run the model on a 128 GB box. Do not expect it to match the full-precision model.
Requires Ollama v0.40.16 or later.
ollama run orcarouter/MiniMax-M3.1-Flash-abliterated
cURL
curl http://localhost:11434/api/chat -d '{
"model": "orcarouter/MiniMax-M3.1-Flash-abliterated",
"messages": [{"role": "user", "content": "Hello!"}]
}'
Python
from ollama import chat
resp = chat(
model="orcarouter/MiniMax-M3.1-Flash-abliterated",
messages=[{"role": "user", "content": "Hello!"}],
)
print(resp["message"]["content"])
message.thinking. Pass
"think": false in the API, or --think=false on the command line, for direct answers. Leave
think unset rather than true: Ollama rejects "think": true for this model.All builds are scored against the lossless GGUF of the same checkpoint. In that GGUF the experts stay native NVFP4, and MXFP8 is decoded bit-exact to BF16; it was verified element by element against the safetensors.
Scoring uses full-vocabulary KLD on held-out chat text: 32 windows of 4096 tokens across English prose, English chat, Chinese chat and Python code, all rendered through the model’s chat template. M3.1 is a chat model and does not continue raw text well. The precision search never saw this text.
Every build is compared with two others at or near its size, quantized from the same weights with the same importance matrix: - llama.cpp’s own mixture - unsloth’s UD-IQ1_M recipe, the smallest build of unsloth’s GGUFs of this model. We read its per-tensor types from their file and rebuilt it here.
| In memory | Fits 128 GB | KLD ↓ | KLD p99 | Top-1 ↑ | PPL vs. original | |
|---|---|---|---|---|---|---|
| Mix-128G (ours) | 111.9 GB | yes | 1.061 | 10.73 | 66.96% | +34.0% |
llama.cpp IQ2_XXS |
112.3 GB | yes | 2.466 | 13.84 | 50.78% | +77.3% |
unsloth UD-IQ1_M recipe |
129.4 GB | no | 0.876 | 10.49 | 70.59% | +0.6% |
At the same size, Mix-128G has less than half the KL divergence of llama.cpp’s IQ2_XXS. unsloth’s smallest recipe scores better, but it is 17.5 GB larger and needs more than 128 GB.
Method note. These are full-vocabulary KLD and next-token agreement on held-out text at 4k context, not a downstream benchmark. Even Q5_K (5.5 bpw) scores KLD ≈0.04 on this model, so the absolute numbers here are higher than on models without QAT.
Measured on the unquantized abliterated checkpoint, not re-measured on these GGUF builds. The KLD above is how far each build sits from that checkpoint.
Setup.
Safety: harmful-prompt refusal (lower = more uncensored). Average 54.9%, against 94.4% for the base model.
| Benchmark | n | Base | Abliterated | Δ |
|---|---|---|---|---|
| AdvBench | 100 | 100% | 44% | −56 |
| JailbreakBench (harmful) | 100 | 96% | 55% | −41 |
| StrongREJECT | 100 | 98% | 42% | −56 |
| HarmBench (standard) | 100 | 97% | 63% | −34 |
| MaliciousInstruct | 100 | 95% | 51% | −44 |
| SimpleSafetyTests | 100 | 88% | 64% | −24 |
| ForbiddenQuestions | 100 | 99% | 47% | −52 |
Over-refusal: benign prompts wrongly refused (lower = better).
| Benchmark | n | Base | Abliterated |
|---|---|---|---|
| XSTest-safe | 250 | 8.8% | 2.4% |
Capability retention.
| Benchmark | n | Base | Abliterated |
|---|---|---|---|
| MMLU (0-shot) | 300 | 84.0% | 83.0% |
| MMLU-Pro (CoT) | 250 | 60.4% | 60.0% |
| GSM8K (CoT) | 150 | 96.7% | 97.3% |
| Base model | The abliterated build of MiniMaxAI/MiniMax-M3.1-Flash |
| Architecture | minimax-m3 in llama.cpp. 60 layers, hidden 6144, GQA 64 q / 4 kv × 128, MiniMax Sparse Attention on every layer (blocks of 128, top-16; full attention on layers 0–2 in this Ollama build), 3 leading dense layers, 128 routed experts top-4 + 1 shared expert |
| Weights in these files | 426B: 413B routed experts, 13B attention / shared expert / dense / embeddings / head. 4 of 128 experts active per token |
| Quantization | Per-group mixed precision found by measured-KLD search. Experts are IQ1_M–IQ2_XXS. Attention, shared expert and dense FFN are Q5_K. Uses an importance matrix. |
| Context | 1,048,576 tokens (inherited; evaluated at 4k) · Vocabulary 200,064 |
| Runtime | llama.cpp with PR #31192, or Ollama v0.40.16+; text in, text out |
MiniMax-M3.1-Flash.The MiniMax Community License, inherited from the base model
MiniMaxAI/MiniMax-M3.1-Flash. It covers
non-commercial use. Commercial use requires “Built with MiniMax M3.1-Flash” attribution and a notice
to, or authorization from, MiniMax. See the license for the terms and its prohibited uses.
Route Smarter · Ship Safer · Spend Less