milkey/deepseek-v2

Fixed memory prediction issues. Limit the number of layers loaded by GPU.

150 7 months ago

1 Tag
... /
template
732caedf08d1 · 112B
{{ if .System }}{{ .System }}
{{ end }}{{ if .Prompt }}User: {{ .Prompt }}
{{ end }}Assistant: {{ .Response }}