home-rag/ granite4.2

6 Downloads Updated 1 month ago

granite4.2:30b-256k-bf16

ollama run home-rag/granite4.2:30b-256k-bf16

curl http://localhost:11434/api/chat \
  -d '{
    "model": "home-rag/granite4.2:30b-256k-bf16",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='home-rag/granite4.2:30b-256k-bf16',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'home-rag/granite4.2:30b-256k-bf16',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

Models

Name

1 model

Size / Usage

Context

Input

granite4.2:30b-256k-bf16

59GB · 256K context window · Text · 1 month ago

granite4.2:30b-256k-bf16

59GB

256K

Text

Readme

IBM GRANITE 4.2 30B

ARCH: GRANITE_4.2 // PARAMS: 30B // PRECISION: BF16 // CONTEXT: 256K TOKENS

Hardware & Environment

Designed for home multi-GPU systems and small GPU grids.

Target hardware: AMD Instinct MI50, MI60, MI100 and MI210 series
Recommended memory: 128+ GB HBM / VRAM

Technical Specifications

Model: Granite 4.2 30B
Origin: Hugging Face ibm-granite/granite-4.2-30b
Precision: BF16
Attention: Full attention with O(N²) compute scaling
Position encoding: RoPE
Context: Up to 262144 tokens

Quick Start

ollama run home-rag/granite4.2:30b-256k-bf16

Reasoning

A snail is at the bottom of a 10‑meter well. Each day it climbs 3 meters, but each night it slips back 2 meters. It starts climbing on Monday morning. On Sunday, the snail is too tired to climb up during the day and must take a break. How many days does it take to escape? Format your answer in Markdown, using UTF‑8. Request you provide a formal proof of your final answer using propositional logic, predicate logic, set theory or such. LaTeX output is strictly prohibited.

# IBM GRANITE 4.2 30B

> ARCH: GRANITE_4.2 // PARAMS: 30B // PRECISION: BF16 // CONTEXT: 256K TOKENS

## Hardware & Environment

Designed for home multi-GPU systems and small GPU grids.

* **Target hardware:** AMD Instinct MI50, MI60, MI100 and MI210 series
* **Recommended memory:** 128+ GB HBM / VRAM

## Technical Specifications

* **Model:** Granite 4.2 30B
* **Origin:** Hugging Face `ibm-granite/granite-4.2-30b`
* **Precision:** BF16
* **Attention:** Full attention with O(N²) compute scaling
* **Position encoding:** RoPE
* **Context:** Up to 262144 tokens

## Quick Start
```
ollama run home-rag/granite4.2:30b-256k-bf16
```
## Reasoning
```A snail is at the bottom of a 10‑meter well. Each day it climbs 3 meters, but each night it slips back 2 meters. It starts climbing on Monday morning. On Sunday, the snail is too tired to climb up during the day and must take a break. How many days does it take to escape? Format your answer in Markdown, using UTF‑8. Request you provide a formal proof of your final answer using propositional logic, predicate logic, set theory or such. LaTeX output is strictly prohibited. ```

![granite-reasoning.png](/assets/home-rag/granite4.2/24e0224b-b974-4199-9cc9-c83e8f15a591)

Paste, drop or click to upload images (.png, .jpeg, .jpg, .svg, .gif)