dlasher/ Nemotron-3.5-Lightning-30B-A3B:IQ4_NL

3 yesterday

pulled as BF16, requant to IQ4_NL, with combined_en_huge as dataset (English + Coding focus) ~25% faster than unsloth UD-IQ4_NL

tools thinking
... /
params
4cb4ac14e55b ยท 242B
{
"min_p": 0.05,
"num_batch": 2048,
"num_ctx": 262144,
"presence_penalty": 0,
"repeat_penalty": 1,
"stop": [
"<|im_start|>",
"<|im_end|>",
"<|endoftext|>",
"<|end_of_text|>"
],
"temperature": 0.3,
"top_k": 40,
"top_p": 0.95
}