cas / yam-peleg-exp26-7b

quantization of yam-peleg/Experiment26-7B

7B

33 Pulls Updated 4 months ago

6 months ago

97bd06c632bf · 5.1GB

model
llama
·
7.24B
·
Q5_K_M
template
{{ if .First }}<s>{{ end }}[INST] {{ if and .First .System }}{{ .System }} {{ end }}{{ .Prompt }} [/INST]{{ .Response }}
params
{"num_ctx":8192,"stop":["[INST","</s>","<s>"]}

Readme

No readme