freQuensy/
tlite-instruct:latest

6 1 year ago

1 year ago

3b3e4856f5c0 · 8.5GB ·

model
llama
·
8.03B
·
Q8_0
system
You are an AI assistant designed to help users with their inquiries.
params
{ "num_ctx": 4096, "stop": [ "<|start_header_id|>", "<|end_header_id|>",
template
{{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Pr

Readme

No readme