14 3 days ago

Initially built this E4B model to fit in my RTX 4060 with 8GB

vision tools thinking
ollama run michaelmontuori/gemma-4-E4B-it-GGUF:UD-Q4_K_XL-128k

Details

3 days ago

bafe6ee9e5e4 · 6.1GB

gemma4
·
7.52B
·
Q4_K_M
clip
·
478M
·
BF16
{{ if .System }}<bos><|turn>system {{ .System }}<turn|> {{ end }}{{ if .Prompt }}<|turn>user {{ .Pro
{ "num_batch": 32, "num_ctx": 131070, "num_gpu": 999, "stop": [ "<turn|>"

Readme

michaelmontuori/gemma-4-E4B-it-GGUF:UD-Q4_K_XL-128k was initially built to fit in my RTX 4060 with 8GB