Bfloat16 version of the Granite3 dense 8B instruct model.
tools
9 Pulls Updated 2 months ago
Updated 2 months ago
2 months ago
f971b31fad92 · 16GB
model
archgranite
·
parameters8.17B
·
quantization(!unknown_file_type 32!)
16GB
system
Knowledge Cutoff Date: April 2024.
You are Granite, developed by IBM.
69B
template
<|start_of_role|>system<|end_of_role|>
{{- if and (gt (len .Messages) 0) (eq (index .Messages 0).Rol
1.4kB
license
Apache License
Version 2.0, January 2004
11kB
Readme
Bfloat16 version of the Granite3 dense 8B instruct model. Requires Ollama >v0.5.5 and BF16 supporting GPU (native or BF16 to FP32 on the fly llama.cpp conversion)
Full model info at https://ollama.com/library/granite3.1-dense and https://huggingface.co/ibm-granite/granite-3.1-8b-instruct/