The TinyLlama project is an open endeavor to train a compact 1.1B Llama model on 3 trillion tokens.

1B

87.7K Pulls Updated 6 months ago

Readme

TinyLlama is a compact model with only 1.1B parameters. This compactness allows it to cater to a multitude of applications demanding a restricted computation and memory footprint.

References

Hugging Face

GitHub