smollm2:135m-instruct-q5_K_S

1.2M 8 months ago

SmolLM2 is a family of compact language models available in three size: 135M, 360M, and 1.7B parameters.

tools 135m 360m 1.7b

8 months ago

11d6886e86ff · 110MB

model
llama
·
135M
·
Q5_K_S
system
You are a helpful AI assistant named SmolLM, trained by Hugging Face
license
Apache License Version 2.0, January 200
params
{ "stop": [ "<|im_start|>", "<|im_end|>" ] }
template
{{- if .Messages }} {{- if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }} {{- range

Readme

y45hIMNREW7w_XpHYB_0q.png

SmolLM2 is a family of compact language models available in three size: 135M, 360M, and 1.7B parameters. They are capable of solving a wide range of tasks while being lightweight enough to run on-device.

benchmark

References

HuggingFace