gurubot / smollm-1.7b-q4m

Instruct model. important - read description

72 Pulls Updated 8 weeks ago

8 weeks ago

81812aeebd19 · 1.1GB

model
llama
·
1.71B
·
Q4_K_M
template
user: {{ .Prompt }} assistant:
params
{"stop":["user:","assistant:"]}

Readme

SmolLM-Instruct 1.7b

Important: nobody seems to have hit on the correct template for this but i’m uploading it with the best performing template I’ve tested. It responds well to most questions but you can’t chat with it like normal, for example if you start by writing “hello” it will probably just respond with maths formula, but you can ask it why the sky is blue, how to bake a cake etc.. It’s very much an “instruct” type interaction.

banner_smol.png

source https://huggingface.co/MaziyarPanahi/SmolLM-1.7B-Instruct-GGUF