SetneufPT/ Gemma4-12B-IT-QAT_Q4_64K_16GB-GPU:latest

1,393 4 months ago

Custom model for coding with agents to use locally with 16gb or 2x8gb GPUs (working fine...)

vision tools thinking 
ollama run SetneufPT/Gemma4-12B-IT-QAT_Q4_64K_16GB-GPU

Details

4 months ago

88326899bb7e · 7.2GB

model
gemma4
·
11.9B
·
Q4_0
projector
clip
·
52.4M
·
BF16
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
system
You are a coding agent. Be concise. Avoid loops. Use tools only when necessary. Do not repeat the sa
license
Credits to Google. Base model: Gemma 4 12B
params
{ "num_ctx": 64000, "repeat_last_n": 4096, "repeat_penalty": 1.1, "seed": 79, "t

Readme

Gemma 4 - 12B param QAT IT, Q4, 64K ctx, Local/Offline, 16GB (or 2x 8GB) GPU

Custom Ollama model, fine-tuned from Gemma4 12b QAT IT, configured for local coding-agent workflows, especially with Claude Code.

This model is based on a 12B parameter IT LLM, quantized in Q4 with QAT and configured with a large context window for software development tasks. It is intended to provide a practical balance between performance, memory usage, and code-assistance quality on local hardware.

Model details

  • Type: Text/image IT model
  • Size: 12B parameters
  • Quantization: Q4 QAT
  • Context target: 64K
  • Real GPU memory usage: 9,3 GB VRAM
  • Recommended GPU memory: 16 GB VRAM
  • Main focus: Coding and agentic development workflows
  • Tool use: Supported, depending on the client/application
  • Thinking/reasoning mode: Supported, depending on the client/application

Intended use

This model is designed for:

  • Agents workflows
  • Local coding assistants
  • Code analysis
  • Debugging support
  • Refactoring suggestions
  • Project exploration
  • Terminal-based programming tasks
  • Educational demonstrations of AI coding agents

image.png