gabegoodhart/
granite3.2-preview

Early preview of IBM Granite 3.2 8B with enhanced reasoning (thinking)

tools 8b

238 5 weeks ago

1 Tag

Readme

Granite 3.2 Preview

The IBM Granite 8B model is an early release of an 8B long-context model fine-tuned for enhanced reasoning (thinking) capabilities. It has been trained using a mix of permissively licensed open-source datasets and internally generated synthetic data designed for reasoning tasks. The model allows controllability of its thinking capability, ensuring it is applied only when required.

Parameter Sizes

8B:

ollama run gabegoodhart/granite3.2-preview

Supported Languages

English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese.

Capabilities

  • Thinking
  • Summarization
  • Text classification
  • Text extraction
  • Question-answering
  • Retrieval Augmented Generation (RAG)
  • Code related tasks
  • Function-calling tasks
  • Multilingual dialog use cases
  • Long-context tasks including long document/meeting summarization, long document QA, etc.

Generation: To enable thinking, add a message with "role": "control" and set "content" to "thinking". For example:

{
    "messages": [
        {"role": "control", "content": "thinking"},
        {"role": "user", "content": "How do I get to the airport if my car won't start?"}
    ]
}

Learn more