34 5 hours ago

NVIDIA Nemotron Nano 9B v2 Uncensored Hybrid Mamba-2 + Transformer (i1-Q4_K_M, 6.5GB, 1M Context). 173.9 tok/s Decode, 11528 tok/s Prefill, 78.6% Precision, 0.0% Hallucination (6/6), 100% Zero-Refusal. License: NVIDIA Open / Apache-2.0.

tools thinking 9b
8f368abe2b15 ยท 168B
{
"num_ctx": 131072,
"repeat_penalty": 1.12,
"stop": [
"<SPECIAL_10>",
"<SPECIAL_11>",
"<SPECIAL_12>"
],
"temperature": 0.65,
"top_k": 40,
"top_p": 0.92
}