smollm:1.7b-base-v0.2-fp16

341.5K 10 months ago

🪐 A family of small models with 135M, 360M, and 1.7B parameters, trained on a new high-quality dataset.

135m 360m 1.7b

10 months ago

64f31ee84d1c · 3.4GB

model
llama
·
1.71B
·
F16
license
Apache License Version 2.0, January 200

Readme

SmolLM is a series of small language models available in three sizes: 135M, 360M, and 1.7B parameters.

References

Blog post

Hugging Face