55 1 month ago

pulled as BF16, vocab slice (text_en_large) requant to IQ4_NL (text_en_large) -- (English only focus) - roughly ~15% faster than stock IQ4_NL

tools thinking