impulse2000 / starling-lm-7b-beta

q2 and f16 versions of the starling-lm-7b-beta model.

7B

42 Pulls Updated 5 months ago

5 months ago

0c851d55af92 · 2.7GB

model
llama
·
7.24B
·
Q2_K
template
{{ if .System }}{{ .System }}<|end_of_turn|>{{ end }}GPT4 Correct User: {{ .Prompt}}<|end_of_turn|>GPT4 Correct Assistant:
params
{"num_ctx":4096,"stop":["<|end_of_turn|>","GPT4 Correct User:","GPT4 Correct Assistant:"]}

Readme

No readme