97 Downloads Updated yesterday
Gemma 4 models are designed to deliver frontier-level performance at each size. They are well-suited for reasoning, agentic workflows, coding, and multimodal understanding.
ollama run bvassie/gemma4:e2b-it-qat-mtp
Applications
ollama launch claude --model bvassie/gemma4:e2b-it-qat-mtp
ollama launch opencode --model bvassie/gemma4:e2b-it-qat-mtp
ollama launch hermes --model bvassie/gemma4:e2b-it-qat-mtp
ollama launch openclaw --model bvassie/gemma4:e2b-it-qat-mtp
Models
View all →Name
7 models
gemma4:e2b-it-qat-mtp
3.5GB · 128K context window · Text, Image · 1 week ago
gemma4:e4b-it-qat-mtp
5.2GB · 128K context window · Text, Image · 1 week ago
gemma4:12b-it-qat-mtp
7.6GB · 256K context window · Text, Image · 1 week ago
gemma4:26b-a4b-it-qat-dflash
16GB · 256K context window · Text, Image · yesterday
gemma4:26b-a4b-it-qat-mtp
16GB · 256K context window · Text, Image · 2 weeks ago
gemma4:31b-it-qat-dflash
20GB · 256K context window · Text, Image · yesterday
gemma4:31b-it-qat-mtp
19GB · 256K context window · Text, Image · 1 week ago
Readme
Created using:
- https://huggingface.co/ggml-org/gemma-4-E2B-it-GGUF
- https://huggingface.co/ggml-org/gemma-4-E4B-it-GGUF
- https://huggingface.co/ggml-org/gemma-4-12B-it-GGUF
- https://huggingface.co/ggml-org/gemma-4-26B-A4B-it-GGUF
- https://huggingface.co/ggml-org/gemma-4-31B-it-GGUF
Modelfile:
FROM ./gemma-4-26B-A4B-it-Q4_0.gguf
FROM ./mmproj-gemma-4-26B-A4B-it-Q8_0.gguf
DRAFT ./mtp-gemma-4-26B-A4B-it-Q4_0.gguf
TEMPLATE {{ .Prompt }}
RENDERER gemma4
PARSER gemma4
PARAMETER top_k 64
PARAMETER top_p 0.95
PARAMETER temperature 1