neralen/
theoutsider:latest

17 1 year ago

1 year ago

45d86b847f66 · 7.4GB

model
llama
·
13B
·
Q4_K_S
template
{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user
params
{ "num_ctx": 2048, "num_gpu": 50, "num_predict": 1024, "num_thread": 6, "repeat_

Readme

No readme