jace-ai/
SmolLM2-German-Instruct:360m-q4_k_m

164 2 months ago

Extensively pre-trained and instruction fine-tuned version of SmolLM2 360M, now supercharged with German language capabilities!

360m

2 months ago

e2ec782a5f8f · 303MB ·

model
llama
·
409M
·
Q4_K_M
template
{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user
license
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
params
{ "num_ctx": 2048, "repeat_penalty": 1.075, "stop": [ "<|im_start|>", "<

Readme

SmolLM2-German-Instruct

Showcase image

This is an extensively pre-trained and instruction fine-tuned version of Hugging Face’s SmolLM2-360m base model in order to improve its German language capabilities. The model has dramatically better German language skills than the base one, is available in several quantizations and performs reasonably well for further instruct fine-tuning on a specific task.

Available quantizations

BF16 (best quality, largest file size): ~820 MB

ollama pull jace-ai/SmolLM2-German-Instruct:360m-bf16

Q8_0 (medium quality, medium file size): ~437 MB

ollama pull jace-ai/SmolLM2-German-Instruct:360m-q8_0

Q4_K_M (lowest quality, smallest file size): ~303 MB

ollama pull jace-ai/SmolLM2-German-Instruct:360m-q4_k_m

Technical details

The model has been trained extensively for 2 days on an NVIDIA RTX 4070 Ti (12 GB VRAM, 285 W TDP). Continued Pretraining was done for 44+ hours while Instruction Fine-Tuning was performed for 4 hours. The model shows a remarkably improved German language performance compared to the base model SmolLM2-360m-Instruct:

SmolLM2-360m-Instruct SmolLM2-360m-German-Instruct
I’m sorry for any confusion, but as an AI and not a real person with the ability to speak in natural human language, I am unable to understand the meaning of your question. Can you please provide more information or clarify what you are asking me about? Gefühle sind eine wichtige Funktion des Lebens, da sie das Wissen und die Ziele von Menschen auf der ganzen Welt vermitteln. Es gibt mehrere Arten von Gefühlen, aber im Allgemeinen sind Gefühle eine komplexe Form von Emotionen, die zwischen den verschiedenen Intelligenz- und Funktionen des Menschen verbunden sind.

For more detail, please refer to the technical report paper linked below.

Links

Citation

@misc{smollm2germaninstruct,
  author       = {Magnus Leonard Schlinsog},
  title        = {Enhancing Foreign Language Proficiency in SmolLM2-360M via Continued Pretraining and Instruction Fine-Tuning},
  year         = {2025},
  url          = {https://huggingface.co/mags0ft/SmolLM2-360m-German-Instruct},
}