q4_k_m quantization only. Now using 8k context size

83 12 months ago

... /
template
bcd7a22a4d9e · 123B
{{- if .First }}{{ .System }} <|end_of_turn>{{- end}}GPT4 Correct User: {{ .Prompt }}<|end_of_turn|>GPT4 Correct Assistant: