doomgrave/ gemma3

269 1 year ago

Gemma3:12b quantized to Q2_K and Q3_K_S for GPU with 8gb Vram or less. Vision module fully working.

3 models

gemma3:latest
9eef8cdc5fc2 • 6.3GB • 128K context window •
Text input • 1 year ago
gemma3:12b-it-q2_K
ae7bb77a27e0 • 5.6GB • 128K context window •
Text input • 1 year ago
gemma3:12b-it-q3_K_S
9eef8cdc5fc2 • 6.3GB • 128K context window •
Text input • 1 year ago