maternion/ lfm2:8b-q8_0

705 2 weeks ago

LFM2-8B-A1B is the best on-device MoE in terms of both quality (comparable to 3-4B dense models) and speed (faster than Qwen3-1.7B).

tools 8b
... /
params
4fdc90d4e9b5 · 55B
{
"min_p": 0.15,
"repeat_penalty": 1.05,
"temperature": 0.3
}