oamazonasgabriel/ nemotron-3.5-lightning:iq4-xs-256k-24gbGPU

170 1 month ago

An open 30B MoE model with ~3B active parameters, packaged by impacte.tech for the execution layer of always-on agents. Uses the official Q4_K_M / IQ4_XS quantizations. Features native tool calling and thinking modes.

tools thinking
... /
params
a6b6d044e21f ยท 148B
{
"num_ctx": 262144,
"num_gpu": 99,
"repeat_penalty": 1,
"stop": [
"<|im_start|>",
"<|im_end|>"
],
"temperature": 1,
"top_k": 20,
"top_p": 0.95
}