ibm/
granite4

1,228 4 days ago

Granite 4 features improved instruction following (IF) and tool-calling capabilities, making them more effective in enterprise applications.

tools

Models

View all →

125 models

granite4:latest

2.1GB · 128K context window · Text · 4 days ago

granite4:micro

2.1GB · 128K context window · Text · 5 days ago

granite4:micro-base-q2_K

1.4GB · 128K context window · Text · 1 week ago

granite4:micro-q2_K

1.4GB · 128K context window · Text · 5 days ago

granite4:micro-base-q3_K_S

1.6GB · 128K context window · Text · 1 week ago

granite4:micro-q3_K_S

1.6GB · 128K context window · Text · 5 days ago

granite4:micro-base-q3_K_M

1.7GB · 128K context window · Text · 1 week ago

granite4:micro-q3_K_M

1.7GB · 128K context window · Text · 5 days ago

granite4:micro-base-q3_K_L

1.9GB · 128K context window · Text · 1 week ago

granite4:micro-q3_K_L

1.9GB · 128K context window · Text · 5 days ago

granite4:micro-base-q4_0

2.0GB · 128K context window · Text · 1 week ago

granite4:micro-base-q4_1

2.2GB · 128K context window · Text · 1 week ago

granite4:micro-h

1.9GB · 1M context window · Text · 5 days ago

granite4:micro-h-base-q2_K

1.2GB · 1M context window · Text · 1 week ago

granite4:micro-h-q2_K

1.2GB · 1M context window · Text · 5 days ago

granite4:micro-h-base-q3_K_S

1.5GB · 1M context window · Text · 1 week ago

granite4:micro-h-q3_K_S

1.5GB · 1M context window · Text · 5 days ago

granite4:micro-h-base-q3_K_M

1.6GB · 1M context window · Text · 1 week ago

granite4:micro-h-q3_K_M

1.6GB · 1M context window · Text · 5 days ago

granite4:micro-h-base-q3_K_L

1.6GB · 1M context window · Text · 1 week ago

granite4:micro-h-q3_K_L

1.6GB · 1M context window · Text · 5 days ago

granite4:micro-h-base-q4_0

1.9GB · 1M context window · Text · 1 week ago

granite4:micro-h-q4_0

1.9GB · 1M context window · Text · 5 days ago

granite4:micro-q4_0

2.0GB · 128K context window · Text · 5 days ago

granite4:micro-h-base-q4_1

2.0GB · 1M context window · Text · 1 week ago

granite4:micro-h-q4_1

2.0GB · 1M context window · Text · 5 days ago

granite4:micro-q4_1

2.2GB · 128K context window · Text · 5 days ago

granite4:micro-base-q4_K_S

2.0GB · 128K context window · Text · 1 week ago

granite4:micro-base-q4_K_M

2.1GB · 128K context window · Text · 1 week ago

granite4:micro-base-q5_0

2.4GB · 128K context window · Text · 1 week ago

granite4:micro-base-q5_1

2.6GB · 128K context window · Text · 1 week ago

granite4:micro-base-q5_K_S

2.4GB · 128K context window · Text · 1 week ago

granite4:micro-base-q5_K_M

2.4GB · 128K context window · Text · 1 week ago

granite4:micro-base-q6_K

2.8GB · 128K context window · Text · 1 week ago

granite4:micro-base-q8_0

3.6GB · 128K context window · Text · 1 week ago

granite4:micro-base-f16

6.8GB · 128K context window · Text · 1 week ago

granite4:micro-h-base-q4_K_S

1.9GB · 1M context window · Text · 1 week ago

granite4:micro-h-q4_K_S

1.9GB · 1M context window · Text · 5 days ago

granite4:micro-q4_K_S

2.0GB · 128K context window · Text · 5 days ago

granite4:micro-h-base-q4_K_M

1.9GB · 1M context window · Text · 1 week ago

granite4:micro-h-q4_K_M

1.9GB · 1M context window · Text · 5 days ago

granite4:micro-q4_K_M

2.1GB · 128K context window · Text · 5 days ago

granite4:micro-h-base-q5_0

2.2GB · 1M context window · Text · 1 week ago

granite4:micro-h-q5_0

2.2GB · 1M context window · Text · 5 days ago

granite4:micro-q5_0

2.4GB · 128K context window · Text · 5 days ago

granite4:micro-h-base-q5_1

2.4GB · 1M context window · Text · 1 week ago

granite4:micro-h-q5_1

2.4GB · 1M context window · Text · 5 days ago

granite4:micro-q5_1

2.6GB · 128K context window · Text · 5 days ago

granite4:micro-h-base-q5_K_S

2.2GB · 1M context window · Text · 1 week ago

granite4:micro-h-q5_K_S

2.2GB · 1M context window · Text · 5 days ago

granite4:micro-q5_K_S

2.4GB · 128K context window · Text · 5 days ago

granite4:micro-h-base-q5_K_M

2.3GB · 1M context window · Text · 1 week ago

granite4:micro-h-q5_K_M

2.3GB · 1M context window · Text · 5 days ago

granite4:micro-q5_K_M

2.4GB · 128K context window · Text · 5 days ago

granite4:micro-h-base-q6_K

2.6GB · 1M context window · Text · 1 week ago

granite4:micro-h-q6_K

2.6GB · 1M context window · Text · 5 days ago

granite4:micro-q6_K

2.8GB · 128K context window · Text · 5 days ago

granite4:micro-h-base-q8_0

3.4GB · 1M context window · Text · 1 week ago

granite4:micro-h-q8_0

3.4GB · 1M context window · Text · 5 days ago

granite4:micro-q8_0

3.6GB · 128K context window · Text · 5 days ago

granite4:micro-f16

6.8GB · 128K context window · Text · 5 days ago

granite4:micro-h-base-f16

6.4GB · 1M context window · Text · 1 week ago

granite4:micro-h-f16

6.4GB · 1M context window · Text · 5 days ago

granite4:small-h

19GB · 1M context window · Text · 5 days ago

granite4:small-h-base-q2_K

12GB · 1M context window · Text · 1 week ago

granite4:small-h-q2_K

12GB · 1M context window · Text · 5 days ago

granite4:small-h-base-q3_K_S

14GB · 1M context window · Text · 1 week ago

granite4:small-h-q3_K_S

14GB · 1M context window · Text · 5 days ago

granite4:small-h-base-q3_K_M

15GB · 1M context window · Text · 1 week ago

granite4:small-h-q3_K_M

15GB · 1M context window · Text · 5 days ago

granite4:small-h-base-q3_K_L

16GB · 1M context window · Text · 1 week ago

granite4:small-h-q3_K_L

16GB · 1M context window · Text · 5 days ago

granite4:small-h-base-q4_0

18GB · 1M context window · Text · 1 week ago

granite4:small-h-q4_0

18GB · 1M context window · Text · 5 days ago

granite4:small-h-base-q4_1

20GB · 1M context window · Text · 1 week ago

granite4:small-h-q4_1

20GB · 1M context window · Text · 5 days ago

granite4:small-h-base-q4_K_S

18GB · 1M context window · Text · 1 week ago

granite4:small-h-q4_K_S

18GB · 1M context window · Text · 5 days ago

granite4:small-h-base-q4_K_M

19GB · 1M context window · Text · 1 week ago

granite4:small-h-q4_K_M

19GB · 1M context window · Text · 5 days ago

granite4:small-h-base-q5_0

22GB · 1M context window · Text · 1 week ago

granite4:small-h-q5_0

22GB · 1M context window · Text · 5 days ago

granite4:small-h-base-q5_1

24GB · 1M context window · Text · 1 week ago

granite4:small-h-q5_1

24GB · 1M context window · Text · 5 days ago

granite4:small-h-base-q5_K_S

22GB · 1M context window · Text · 1 week ago

granite4:small-h-q5_K_S

22GB · 1M context window · Text · 5 days ago

granite4:small-h-base-q5_K_M

23GB · 1M context window · Text · 1 week ago

granite4:small-h-q5_K_M

23GB · 1M context window · Text · 5 days ago

granite4:small-h-base-q6_K

26GB · 1M context window · Text · 1 week ago

granite4:small-h-q6_K

26GB · 1M context window · Text · 5 days ago

granite4:small-h-base-q8_0

34GB · 1M context window · Text · 1 week ago

granite4:small-h-q8_0

34GB · 1M context window · Text · 5 days ago

granite4:small-h-base-f16

64GB · 1M context window · Text · 1 week ago

granite4:small-h-f16

64GB · 1M context window · Text · 4 days ago

granite4:tiny-h

4.2GB · 1M context window · Text · 5 days ago

granite4:tiny-h-base-q2_K

2.6GB · 1M context window · Text · 1 week ago

granite4:tiny-h-q2_K

2.6GB · 1M context window · Text · 5 days ago

granite4:tiny-h-base-q3_K_S

3.1GB · 1M context window · Text · 1 week ago

granite4:tiny-h-q3_K_S

3.1GB · 1M context window · Text · 5 days ago

granite4:tiny-h-base-q3_K_M

3.4GB · 1M context window · Text · 1 week ago

granite4:tiny-h-q3_K_M

3.4GB · 1M context window · Text · 5 days ago

granite4:tiny-h-base-q3_K_L

3.6GB · 1M context window · Text · 1 week ago

granite4:tiny-h-q3_K_L

3.6GB · 1M context window · Text · 5 days ago

granite4:tiny-h-base-q4_0

4.0GB · 1M context window · Text · 1 week ago

granite4:tiny-h-q4_0

4.0GB · 1M context window · Text · 5 days ago

granite4:tiny-h-base-q4_1

4.4GB · 1M context window · Text · 1 week ago

granite4:tiny-h-q4_1

4.4GB · 1M context window · Text · 5 days ago

granite4:tiny-h-base-q4_K_S

4.0GB · 1M context window · Text · 1 week ago

granite4:tiny-h-q4_K_S

4.0GB · 1M context window · Text · 5 days ago

granite4:tiny-h-base-q4_K_M

4.2GB · 1M context window · Text · 1 week ago

granite4:tiny-h-q4_K_M

4.2GB · 1M context window · Text · 5 days ago

granite4:tiny-h-base-q5_0

4.8GB · 1M context window · Text · 1 week ago

granite4:tiny-h-q5_0

4.8GB · 1M context window · Text · 5 days ago

granite4:tiny-h-base-q5_1

5.2GB · 1M context window · Text · 1 week ago

granite4:tiny-h-q5_1

5.2GB · 1M context window · Text · 5 days ago

granite4:tiny-h-base-q5_K_S

4.8GB · 1M context window · Text · 1 week ago

granite4:tiny-h-q5_K_S

4.8GB · 1M context window · Text · 5 days ago

granite4:tiny-h-base-q5_K_M

4.9GB · 1M context window · Text · 1 week ago

granite4:tiny-h-q5_K_M

4.9GB · 1M context window · Text · 5 days ago

granite4:tiny-h-base-q6_K

5.7GB · 1M context window · Text · 1 week ago

granite4:tiny-h-q6_K

5.7GB · 1M context window · Text · 5 days ago

granite4:tiny-h-base-q8_0

7.4GB · 1M context window · Text · 1 week ago

granite4:tiny-h-q8_0

7.4GB · 1M context window · Text · 5 days ago

granite4:tiny-h-base-f16

14GB · 1M context window · Text · 1 week ago

granite4:tiny-h-f16

14GB · 1M context window · Text · 5 days ago

Readme

Granite 4.0 models

Granite 4.0 models are finetuned from their base models using a combination of open source instruction datasets with permissive license and internally collected synthetic datasets. They feature improved instruction following (IF) and tool-calling capabilities, making them more effective in enterprise applications.

Please Note: our micro model is an alternative option for users when mamba-2 support is not yet optimized.

Parameter Sizes

micro (3B)

ollama run ibm/granite4:micro

micro (3B)

ollama run ibm/granite4:micro-h

tiny (7B)

ollama run ibm/granite4:tiny-h

small (32B)

ollama run ibm/granite4:small-h

other quantizations Models above have a default quantization of Q4_K_M. To run other quantizations (e.g., Q8): ollama run ibm/granite4:tiny-h-q8_0

base models Base models without instruction tuning are provided for all sizes and quantizations. These can be accessed with tags such as ibm/granite4:tiny-h-base-f16.

Supported Languages

Supported Languages: English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese. Users may finetune Granite 4.0 models for languages beyond these languages.

Intended Use

This model is designed to handle general instruction-following tasks and can be integrated into AI assistants across various domains, including business applications.

Capabilities

  • Summarization
  • Text classification
  • Text extraction
  • Question-answering
  • Retrieval Augmented Generation (RAG)
  • Code related tasks
  • Function-calling tasks
  • Multilingual dialog use cases
  • Fill-In-the-Middle (FIM) code completions

Learn more