This model is a fine-tuned version of allenai/OLMo-1B-hf on the HuggingFaceH4/ultrachat_200k dataset

28 4 months ago

Readme

zephyr-1b-olmo-sft-qlora

https://ritvik19.github.io/small-llms/

This model is a fine-tuned version of allenai/OLMo-1B-hf on the HuggingFaceH4/ultrachat_200k dataset. It achieves the following results on the evaluation set: - Loss: 1.3126

(from: https://huggingface.co/Ritvik19/zephyr-1b-olmo-sft-qlora)

Model conversion by https://huggingface.co/Felladrin/gguf-zephyr-1b-olmo-sft-qlora