29 2 months ago

Unofficial Customized version of Granite 3.3 with Thinking Enabled. The Granite can think!

tools 2b 8b

Models

View all →

Readme

Thinking-Granite3.3: An unofficial tweaked version of the popular Granite 3.3 Language Model

Overview

Thinking-Granite3.3 is based on the reasoning capable Granite 3.3 language model by IBM, specifically configured to default to using reasoniong to resolve queries.

Parameter Sizes

Thinking-Granite3.3 comes in 2 parameter sizes: 2B and 8B.

Broadly speaking, more compute resources, including more CPU/GPU performance, memory, and storage, are required with more active parameters in a Language Model.

2B:

Great for:

  • Local/Edge devices with constrained memory or performance
  • Lower latency/higher throughput on less constrained hardware

Download 2B via

ollama run alastairlundy/Thinking-Granite3.3:2b

8B:

Great for:

  • Local/Edge devices with strong memory or performance
  • Local/Edge strong reasoning performance

Download 8B via

ollama run alastairlundy/Thinking-Granite3.3:8b

Capabilities

As it is based on Granite 3.3, Thinking-Granite3.3 supports all capabilities that it natively supports such as:

  • Reasoning
  • Question-answering
  • Retrieval Augmented Generation (RAG)
  • Tool calling
  • Function-calling tasks

For a full list see the Granite 3.3 model

Thinking

No configuration is needed to enable Thinking. It is automatically enabled.

NOTE: Thinking mode is not currently enabled during tool calling but may be enabled in a future version.

Example Query

I’m going shopping later. How many eggs do I need to buy for a vegan cake?

Thinking Process:

<think>The question pertains to preparing a vegan cake, which inherently does not use animal products like eggs. Therefore, if you're baking a vegan cake, you will not 
need to include eggs in your list of ingredients for substitution because the recipe is designed without them.

Vegan cakes often substitute eggs with various plant-based alternatives such as:

1. **Flaxseeds or Chia Seeds**: Mix 1 tablespoon of ground flaxseed or chia seeds with 3 tablespoons of water per egg. Let it sit to gel before using.
2. **Applesauce**: Use 1/4 cup of unsweetened applesauce for every egg.
3. **Banana**: Half a mashed banana (approximately 60 grams) can substitute one egg.
4. **Silken Tofu**: A quarter cup of pureed silken tofu serves as an excellent egg replacer.
5. **Aquafaba** (from chickpea brine): One tablespoon of aquafaba is comparable to one egg white.
6. **Commercial Egg Replacers**: Products specifically designed for this purpose are available in stores or online.

The amount of these substitutes needed would depend on the specific vegan cake recipe you're following, which dictates the required texture and binding properties 
typically provided by eggs. Generally, the exact substitution rate is an ingredient-specific factor. However, for a standard vegan cake recipe, none of these 
substitutes will typically require more than several eggs (often just a few tablespoons or equivalent), depending on the volume of egg replacements needed per unit in 
the original recipe.</think>

Result:

<response>### Vegan Cake Ingredient Considerations

For a vegan cake, you do **not** need to buy eggs. Traditional vegan cakes use plant-based alternatives to mimic the properties of eggs:

1. **Flaxseeds or Chia Seeds**: 1 tablespoon ground mixed with 3 tablespoons water per egg.
2. **Applesauce**: Use 1/4 cup unsweetened for every egg.
3. **Banana**: Half a mashed banana (60 grams) can replace one egg.
4. **Silken Tofu**: Quarter cup of pureed tofu is comparable to one egg.
5. **Aquafaba**: One tablespoon equivalents to one egg white.

The specific number of these substitutes you need depends on the recipe's requirements and how many eggs it originally calls for, as well as personal preference in 
texture. A typical vegan cake may only require a small amount (e.g., 3-5 tablespoons) if the original recipe heavily depended on eggs for structure or leavening.

**Conclusion**:
You do not need to buy any additional eggs specifically for a vegan cake, as these cakes are designed without them using suitable plant-based alternatives based on your 
chosen recipe's needs.</response>

Acknowledgements/Relations to Official Granite

Thanks to IBM Research for creating the Official Granite family of models!

Thinking-Granite3.3 is not affiliated with IBM or the Official Granite family of models.

For more information please see this NOTICE

Learn More