Bfloat16 version of the Marco-o1 7B model.

2 2 months ago

Readme

Bfloat16 version of the Marco-o1 7B model. Requires Ollama >v0.5.5 and BF16 supporting GPU (native or BF16 to FP32 on the fly llama.cpp conversion)

Full model info at https://ollama.com/library/marco-o1 and https://huggingface.co/AIDC-AI/Marco-o1