rjmalagon/
granite3.1-dense:8b-instruct-bf16

9 8 months ago

Bfloat16 version of the Granite3 dense 8B instruct model.

tools

8 months ago

f971b31fad92 · 16GB ·

model
granite
·
8.17B
·
(!unknown_file_type 32!)
system
Knowledge Cutoff Date: April 2024. You are Granite, developed by IBM.
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
template
<|start_of_role|>system<|end_of_role|> {{- if and (gt (len .Messages) 0) (eq (index .Messages 0).Rol

Readme

Bfloat16 version of the Granite3 dense 8B instruct model. Requires Ollama >v0.5.5 and BF16 supporting GPU (native or BF16 to FP32 on the fly llama.cpp conversion)

Full model info at https://ollama.com/library/granite3.1-dense and https://huggingface.co/ibm-granite/granite-3.1-8b-instruct/