66 5 days ago

0.0% Hallucination (6/6 Checks) & Heretic Q8_0 8-Bit Uncensored (5/5 Gate, 8/9 Suite A) Baidu ERNIE-4.5 21.8B MoE (3B active, 131K ctx, Apache-2.0) — 151.8 tok/s decode & 5,273 tok/s prefill in 22.4 GiB VRAM.

21b
519c5c958d91 · 150B
<|begin_of_sentence|>{{ if .System }}{{ .System }}
{{ end }}{{ if .Prompt }}User: {{ .Prompt }}
{{ end }}Assistant: {{ .Response }}<|end_of_sentence|>