cas / sauerkrautlm-gemma

quantization of VAGOsolutions/SauerkrautLM-Gemma-7b

118 Pulls Updated 8 months ago

Updated 8 months ago

8 months ago

d13ba5e71054 · 5.3GB

parameters8.54B

quantizationQ4_K_M

Du bist ein hilfreicher Assistent.

{{ .System }} USER: {{ .Prompt }} ASSISTANT:

{"stop":["USER:","ASSISTANT:","\u003c/s\u003e","\u003c/p\u003e"]}

Readme

from https://huggingface.co/VAGOsolutions/SauerkrautLM-Gemma-7b experimental. maybe inconsistent templates?