neoali/
qaunt-model-8k:latest

5 10 months ago

10 months ago

b0f6294842da · 4.9GB ·

model
llama
·
8.03B
·
Q4_K_M
template
{{- range .Messages }}<|start_header_id|>{{ .Role }}<|end_header_id|> {{ .Content }}<|eot_id|> {{- e
params
{ "num_ctx": 8192, "stop": [ "<|start_header_id|>", "<|end_header_id|>",

Readme

No readme