Granite 3.2 Preview

The IBM Granite 8B model is an early release of an 8B long-context model fine-tuned for enhanced reasoning (thinking) capabilities. It has been trained using a mix of permissively licensed open-source datasets and internally generated synthetic data designed for reasoning tasks. The model allows controllability of its thinking capability, ensuring it is applied only when required.

Parameter Sizes

8B:

ollama run gabegoodhart/granite3.2-preview

Supported Languages

English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese.

Capabilities

• Thinking
• Summarization
• Text classification
• Text extraction
• Question-answering
• Retrieval Augmented Generation (RAG)
• Code related tasks
• Function-calling tasks
• Multilingual dialog use cases
• Long-context tasks including long document/meeting summarization, long document QA, etc.

Generation: To enable thinking, add a message with "role": "control" and set "content" to "thinking". For example:

{
    "messages": [
        {"role": "control", "content": "thinking"},
        {"role": "user", "content": "How do I get to the airport if my car won't start?"}
    ]
}

Learn more

• Developers: IBM Research
• Website: Granite Docs
• Release Date: February 7th, 2025
• License: Apache 2.0