10 models
Context-optimized variant of IBM's Granite 4.2 3B model, tuned for lightweight tool-use on GPU-constrained hosts.
Context-optimized variant of IBM's Granite 4.1 3B model, tuned for lightweight tool-use on GPU-constrained hosts.
Reduced-refusal IBM Granite 4.2 3B via Heretic: 27/100 refusals (from 98), KL 0.085. Apache-2.0, multilingual.
Granite-4.0-H-350M is a lightweight instruct model finetuned from Granite-4.0-H-350M-Base using a combination of open-source instruction datasets with permissive license and internally collected synthetic datasets.
pulled as BF16, vocab slice (combined_en_huge) requant to IQ4_NL (combined_en_huge) -- (English + Coding focus) - ~20% faster than Q4_K_M
pulled as BF16, requant to IQ4_NL, with combined_en_huge as dataset (English + Coding focus)
Base model: https://huggingface.co/ibm-granite/granite-4.0-h-350m-base-GGUF
granite4.2:30b-256k-bf16
gemma 4 31B trained on conversation with strict persona and thought trace