s1gnature/ gemma4-mtp:e2b-q4_k_m

1,083 2 weeks ago

Gemma 4 E4B & E2B (Q4_K_M) with MTP drafter. 32k context, up to 80 TPS on RTX 3050 8GB.

vision tools thinking
... /
template
b4e5c65167af ยท 165B
{{ if .System }}<bos><|turn>system
{{ .System }}<turn|>
{{ end }}{{ if .Prompt }}<|turn>user
{{ .Prompt }}<turn|>
{{ end }}<|turn>model
{{ .Response }}<turn|>