30.4K 9 months ago

Specialized uncensored quants for new OpenAI 20B MOE - Mixture of Experts Model at 80+ T/S. "HERETIC" method results in a model (quantized Q5_1)

thinking 20b
d8ba2f9a17b3 ยท 18B
{
"temperature": 1
}