70 6 days ago

0.0% Hallucination (6/6 Checks) & Heretic Q8_0 8-Bit Uncensored (5/5 Gate, 8/9 Suite A) Baidu ERNIE-4.5 21.8B MoE (3B active, 131K ctx, Apache-2.0) — 151.8 tok/s decode & 5,273 tok/s prefill in 22.4 GiB VRAM.

21b