Bfloat16 version of the Falcon 3 10B model.

6 2 months ago

Readme

Bfloat16 version of the Falcon 3 10B model. Requires Ollama >v0.5.5 and BF16 supporting GPU (native or BF16 to FP32 on the fly llama.cpp conversion)

Full model info at https://ollama.com/library/falcon3 and https://huggingface.co/tiiuae/Falcon3-10B-Instruct