QyrouNnet/ summarizer:400m-q8_0

43 1 week ago

QN-Summarizer-1 is a 400M parameter model specialized for summarization, outperforming ~20B models on benchmarks. Delivers ~1.5s CPU and millisecond GPU inference. Accepts up to 7,000 words for fast, high-quality document summarization.

400m
... /
template
9d7d0f6d1205 · 105B
{{- if .Prompt }}<|im_start|>user
{{ .Prompt }}<|im_end|>
{{- end }}<|im_start|>assistant
{{ .Response }}