174 1 year ago

quantization of VAGOsolutions/SauerkrautLM-Gemma-7b

1 year ago

d13ba5e71054 · 5.3GB ·

gemma
·
8.54B
·
Q4_K_M
{{ .System }} USER: {{ .Prompt }} ASSISTANT:
{ "stop": [ "USER:", "ASSISTANT:", "</s>", "</p>" ] }
Du bist ein hilfreicher Assistent.

Readme

from https://huggingface.co/VAGOsolutions/SauerkrautLM-Gemma-7b experimental. maybe inconsistent templates?