sam860/
granite3.3:2b-Q8_0

4 1 month ago

Additional quants of the granite3.3:2b model

tools 2b

1 month ago

1770298bae56 · 2.7GB ·

model
granite
·
2.53B
·
Q8_0
template
{{- /* ------ MESSAGE PARSING ------ */}} {{- /* Declare the prompt structure variables to be filled

Readme

Granite‑3.3‑2B‑Instruct (Apr 2025) — IBM’s 128K‑context instruct model, fine‑tuned for reasoning, math, coding, and multilingual tasks. Ideal for:
- Long‑context summarization & QA (meetings, docs)
- Math & code generation with step‑by‑step reasoning
- Multilingual assistants (12 languages supported)
- Function‑calling & RAG pipelines

References

HuggingFace