bvassie/gemma4:12b-it-qat-mtp

bvassie/ gemma4:12b-it-qat-mtp

97 Downloads Updated yesterday

Gemma 4 models are designed to deliver frontier-level performance at each size. They are well-suited for reasoning, agentic workflows, coding, and multimodal understanding.

vision tools thinking

ollama run bvassie/gemma4:12b-it-qat-mtp

curl http://localhost:11434/api/chat \
  -d '{
    "model": "bvassie/gemma4:12b-it-qat-mtp",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='bvassie/gemma4:12b-it-qat-mtp',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'bvassie/gemma4:12b-it-qat-mtp',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Details

Updated 1 week ago

1 week ago

858b21faf630 · 7.6GB ·

model

archgemma4

parameters11.9B

quantizationQ4_0

7.2GB

projector

archclip

parameters52.4M

quantizationQ8_0

159MB

draft

GGUF��1��2��general.architecture��gemma4-assistant��general.type

254MB

params

{ "temperature": 1, "top_k": 64, "top_p": 0.95 }

42B

template

13B

Readme

Created using:

Modelfile:

FROM ./gemma-4-26B-A4B-it-Q4_0.gguf
FROM ./mmproj-gemma-4-26B-A4B-it-Q8_0.gguf
DRAFT ./mtp-gemma-4-26B-A4B-it-Q4_0.gguf
TEMPLATE {{ .Prompt }}
RENDERER gemma4
PARSER gemma4
PARAMETER top_k 64
PARAMETER top_p 0.95
PARAMETER temperature 1