s1gnature/ gemma4-mtp:e2b-q8_0

1,083 2 weeks ago

Gemma 4 E4B & E2B (Q4_K_M) with MTP drafter. 32k context, up to 80 TPS on RTX 3050 8GB.

vision tools thinking
... /
params
cacb0b3c87f1 ยท 69B
{
"draft_num_predict": 2,
"num_ctx": 32000,
"stop": [
"<turn|>"
]
}