80 22 hours ago

Gemma 4 12B uncensored: first Gemma certified 10/10 at 1M, fits a 32GB card. Vision included.

vision tools thinking
ollama run satgeze/gemma4-12b-uncensored-1m

Details

22 hours ago

4d017656f27b · 7.6GB ·

gemma4
·
11.9B
·
Q4_K_M
clip
·
52.4M
·
BF16
{ "num_ctx": 262144 }

Readme

Gemma 4

Gemma 4 12B Uncensored, 1M certified

HauhauCS’s uncensored Gemma-4-12B (Google QAT checkpoint) with a 1,048,576-token context baked in and vision attached. The first Gemma 4 we know of certified needle-perfect at the full million tokens, and the entire certification ran inside a 32GB GPU. Native renderer and parser set:

ollama launch claude --model satgeze/gemma4-12b-uncensored-1m

Verified, not claimed

NIAH heatmap

1010 at every rung from 64K through 1M (f16 KV, temperature 0). One cell missed on a first seed and passed on a second; both runs are published in the repo data.

Tags

Tag Size Note
latest 7.6GB The only quant in existence: Google ships this QAT checkpoint in 4-bit only, so this is the complete set

Gemma’s 5:1 sliding-window attention keeps KV tiny: the full 1M fits on a 32GB card. Raise with /set parameter num_ctx 1048576.

MTP note

A separate 254MB draft head lives on the repo (+51 percent decode under llama.cpp with -md); Ollama has no speculative decoding yet.

Links

Full repo, raw data, charts: Hugging Face | ModelScope Method and harness: github.com/satindergrewal/aviary-1m

Credits: Google (Gemma 4 + QAT; Gemma license), HauhauCS (uncensoring), Unsloth (MTP head), SatGeze (1M extension, certification).