jewelzufo/
unsloth_granite-4.0-h-350m-GGUF

56 1 week ago

Granite-4.0-H-350M is a lightweight instruct model finetuned from Granite-4.0-H-350M-Base using a combination of open-source instruction datasets with permissive license and internally collected synthetic datasets.

tools

16 models

unsloth_granite-4.0-h-350m-GGUF:latest
090240d60748 • 223MB • 1M context window •
Text input • 2 weeks ago
unsloth_granite-4.0-h-350m-GGUF:Q3_K_XL
38a545a1be98 • 191MB • 1M context window •
Text input • 1 week ago
unsloth_granite-4.0-h-350m-GGUF:Q4_K_XL
cd8736cab39b • 225MB • 1M context window •
Text input • 1 week ago
unsloth_granite-4.0-h-350m-GGUF:Q5_K_XL
80a1e314bdab • 253MB • 1M context window •
Text input • 1 week ago
unsloth_granite-4.0-h-350m-GGUF:Q6_K_XL
51b0882498a0 • 311MB • 1M context window •
Text input • 1 week ago
unsloth_granite-4.0-h-350m-GGUF:Q8_K_XL
0f620b8a5be3 • 461MB • 1M context window •
Text input • 1 week ago
unsloth_granite-4.0-h-350m-GGUF:Q3_K_M
da85668dce33 • 189MB • 1M context window •
Text input • 1 week ago
unsloth_granite-4.0-h-350m-GGUF:Q4_K_M
090240d60748 • 223MB • 1M context window •
Text input • 1 week ago
unsloth_granite-4.0-h-350m-GGUF:Q5_K_M
6fdc569352f0 • 252MB • 1M context window •
Text input • 1 week ago
unsloth_granite-4.0-h-350m-GGUF:Q6_K
df54df8c218b • 284MB • 1M context window •
Text input • 1 week ago
unsloth_granite-4.0-h-350m-GGUF:IQ3_XXS
e8b1bba69743 • 160MB • 1M context window •
Text input • 1 week ago
unsloth_granite-4.0-h-350m-GGUF:IQ4_XS
572ada16bb2e • 208MB • 1M context window •
Text input • 1 week ago
unsloth_granite-4.0-h-350m-GGUF:IQ4_NL
d2d243b044c5 • 216MB • 1M context window •
Text input • 1 week ago
unsloth_granite-4.0-h-350m-GGUF:BF16
14782e6cc1ac • 685MB • 1M context window •
Text input • 1 week ago
unsloth_granite-4.0-h-350m-GGUF:Base-Q6_K
c04c2f17f264 • 284MB • 1M context window •
Text input • 1 week ago
unsloth_granite-4.0-h-350m-GGUF:Base-Q8_0
7aeae4c15726 • 366MB • 1M context window •
Text input • 1 week ago