66 5 days ago

0.0% Hallucination (6/6 Checks) & Heretic Q8_0 8-Bit Uncensored (5/5 Gate, 8/9 Suite A) Baidu ERNIE-4.5 21.8B MoE (3B active, 131K ctx, Apache-2.0) — 151.8 tok/s decode & 5,273 tok/s prefill in 22.4 GiB VRAM.

21b
8fe0bb451d2b · 87B
{
"num_ctx": 32768,
"stop": [
"<|end_of_sentence|>",
"\nUser:"
],
"temperature": 0.2
}