73 19 hours ago

Agent-optimized 9B heretic: 1M context, MTP, vision. 50/50 needles to 524K, uncensored.

vision tools thinking
ollama run satgeze/qwenpaw-9b-heretic-1m

Applications

Claude Code
Claude Code ollama launch claude --model satgeze/qwenpaw-9b-heretic-1m
Codex App
Codex App ollama launch codex-app --model satgeze/qwenpaw-9b-heretic-1m
OpenClaw
OpenClaw ollama launch openclaw --model satgeze/qwenpaw-9b-heretic-1m
Hermes Agent
Hermes Agent ollama launch hermes --model satgeze/qwenpaw-9b-heretic-1m
Codex
Codex ollama launch codex --model satgeze/qwenpaw-9b-heretic-1m
OpenCode
OpenCode ollama launch opencode --model satgeze/qwenpaw-9b-heretic-1m

Models

View all →

Readme

QwenPaw

QwenPaw-Flash-9B heretic, 1M context

SC117’s heretic-abliterated build of agentscope-ai’s QwenPaw-Flash-9B (an agent-optimized finetune of Qwen3.5-9B), with a 1,048,576-token context baked in, the official MTP layer, and vision attached. Uncensored, agent-tuned, needle-tested. Native renderer and parser set, so tool calling works out of the box:

ollama launch claude --model satgeze/qwenpaw-9b-heretic-1m

Verified, not claimed

NIAH heatmap

5050 needles at every rung from 64K through 524K (Q8_0, f16 KV, temperature 0, RTX 5090). The 786K and 1M rungs are running on a 128GB Mac at publish time; this page and the heatmap update when they land.

MTP speedup

Tags

Tag Size When
latest 9.8GB Q8_0, max quality, MTP layer baked in
q4_k_m 5.8GB Smaller, 32GB-friendly

Both carry the 1M rope metadata and the vision tower. Raise context with /set parameter num_ctx.

MTP note

Measured +25 percent decode under llama.cpp with speculation active (acceptance 0.70). Dormant in Ollama until speculative decoding ships there, then it activates automatically with no re-pull. On the upstream “1.7 to 4.1x” claims: those were time-scored agent benchmarks; speculative decoding cannot change model outputs at temperature 0, so treat score gains from MTP as timing artifacts. The honest, controlled decode gain is +25 percent.

Links

Full repo, raw data, heatmap: Hugging Face | ModelScope Method and harness: github.com/satindergrewal/aviary-1m

Credits: Qwen (base + MTP layer, Apache-2.0), agentscope-ai (QwenPaw agent finetune), SC117 (heretic abliteration + MTP re-injection), SatGeze (1M extension, certification).