oamazonasgabriel/ nemotron-3.5-lightning:q4-24gbGPU

170 1 month ago

An open 30B MoE model with ~3B active parameters, packaged by impacte.tech for the execution layer of always-on agents. Uses the official Q4_K_M / IQ4_XS quantizations. Features native tool calling and thinking modes.

tools thinking
... /
template
4d076571c314 ยท 159B
{{- if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant
{{ .Response }}<|im_end|>