granite4:micro-h

3,731 21 hours ago

Granite 4 features improved instruction following (IF) and tool-calling capabilities, making them more effective in enterprise applications.

tools

yesterday

ba791654cc27 · 1.9GB ·

model
granitehybrid
·
3.19B
·
Q4_K_M
template
{{- /* ------ MESSAGE PARSING ------ */}} {{- /* Declare the system prompt chunks used for different
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US

Readme

Granite 4.0 models

Granite 4.0 models are finetuned from their base models using a combination of open source instruction datasets with permissive license and internally collected synthetic datasets. They feature improved instruction following (IF) and tool-calling capabilities, making them more effective in enterprise applications.

Please Note: our micro model is an alternative option for users when mamba-2 support is not yet optimized.

Parameter Sizes

micro (3B)

ollama run granite4:micro

micro-h (3B)

ollama run granite4:micro-h

tiny-h (7B)

ollama run granite4:tiny-h

small-h (32B):

ollama run granite4:small-h

Supported Languages

English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese. Users may finetune Granite 4.0 models for languages beyond these languages.

Intended Use

This model is designed to handle general instruction-following tasks and can be integrated into AI assistants across various domains, including business applications.

Capabilities

  • Summarization
  • Text classification
  • Text extraction
  • Question-answering
  • Retrieval Augmented Generation (RAG)
  • Code related tasks
  • Function-calling tasks
  • Multilingual dialog use cases
  • Fill-In-the-Middle (FIM) code completions

Learn more