QyrouNnet/ summarizer:400m-q4_k_m

43 1 week ago

QN-Summarizer-1 is a 400M parameter model specialized for summarization, outperforming ~20B models on benchmarks. Delivers ~1.5s CPU and millisecond GPU inference. Accepts up to 7,000 words for fast, high-quality document summarization.

400m
... /
params
dac516acafac · 126B
{
"num_ctx": 8192,
"repeat_penalty": 1.05,
"stop": [
"<|im_start|>",
"<|im_end|>"
],
"temperature": 0.2,
"top_p": 0.9
}