67 Downloads Updated 20 hours ago
ollama run FableForge-AI/mythos-v2-9b:q4_k_m
Updated 21 hours ago
21 hours ago
7016a473f272 · 5.8GB
Zero refusals. 13.7⁄15 benchmark. Hybrid linear attention, 256K context.
Mythos V2-9B is an uncensored fine-tune of Qwen3.5-9B. It answers everything without disclaimers, warnings, or refusals — 10⁄10 sensitive prompts answered in our benchmark suite — and it’s built for agent work: tool use, shell commands, code generation, multi-step reasoning.
ollama run FableForge-AI/mythos-v2-9b
| Tag | Size | Use it for |
|---|---|---|
:q2_k |
3.9 GB | Tightest RAM (8 GB machines) — quality loss expected |
:q3_k_m |
4.7 GB | Low-RAM floor with usable quality |
:q4_0 |
5.5 GB | Legacy fast quant |
:q4_k_m |
5.8 GB | Default — best quality/size, benchmarked below |
:q5_k_m |
6.6 GB | A bit more headroom if RAM allows |
:q6_k |
7.6 GB | Near-lossless |
:latest |
5.8 GB | Same as :q4_k_m |
| Hardware | Run mode | Speed |
|---|---|---|
| M3 Mac (24 GB) | Full GPU | ~2.8–3.5 tok/s gen, ~45 tok/s prompt eval |
| BF16 via MLX (Apple Silicon) | Full GPU | ~1.8 tok/s |
| RTX 3060+ (12 GB) | Full GPU | untested — expect ≥ M3 |
| No GPU, 8 GB RAM | CPU only | slow; prefer :q3_k_m or smaller |
Size: 5.8 GB (Q4_K_M) · Context: 256K arch (trained at 2048) · Base: Qwen3.5-9B
Honest note: Qwen3.5’s hybrid linear-attention kernels in Ollama/llama.cpp are still unoptimized — dense Qwen3 9B quants reach ~7 tok/s on the same machine. Quality is unaffected; speed should improve as upstream kernels mature.
| Metric | Q4_K_M (Ollama) | BF16 (MLX) |
|---|---|---|
| Censorship bypass (10⁄10 answered both runs) | 4.9⁄5 | 5.0/5 |
| Tool-Use | 4.5⁄5 | 4.6⁄5 |
| Reasoning | 4.2⁄5 | 4.0/5 |
| Total | 13.7⁄15 | 13.62⁄15 |
| Model | Censorship | Tool-Use | Reasoning | Total | Speed |
|---|---|---|---|---|---|
| V2-9B (this) | 5.0 | 4.6 | 4.0 | 13.6–13.7⁄15 | 2.8–3.5 tok/s (Q4) |
| Mythos 9B-Opt | 4.8 | 4.6 | 4.5 | 13.9⁄15 | 7.7 tok/s |
| Enhanced | 5.0 | 5.0 | 3.8 | 13.8⁄15 | 9.6 tok/s |
| V2-8B | 3.4 | 4.0 | 4.0 | 11.4⁄15 | 4.8 tok/s |
| Unhinged | 3.0 | 3.8 | 2.2 | 9.0/15 | 10.3 tok/s |
/no_think in Ollama.| Parameter | Value |
|---|---|
| Base model | Qwen/Qwen3.5-9B |
| Fine-tune | V2 uncensored mix (agent traces + reasoning + code) |
| Trained context | 2048 tokens |
| License | Apache 2.0 |
Part of the FableForge ecosystem — uncensored AI for everyone.