sam860/
granite3.3:2b-Q6_K

4 1 month ago

Additional quants of the granite3.3:2b model

tools 2b

1 month ago

c51060af27a9 · 2.1GB ·

model
granite
·
2.53B
·
Q6_K
template
{{- /* ------ MESSAGE PARSING ------ */}} {{- /* Declare the prompt structure variables to be filled

Readme

Granite‑3.3‑2B‑Instruct (Apr 2025) — IBM’s 128K‑context instruct model, fine‑tuned for reasoning, math, coding, and multilingual tasks. Ideal for:
- Long‑context summarization & QA (meetings, docs)
- Math & code generation with step‑by‑step reasoning
- Multilingual assistants (12 languages supported)
- Function‑calling & RAG pipelines

References

HuggingFace