NOTE: This model has been heavily vocab-sliced to reduce non-coding and non-English tokens. YMMV. (Mandarin, Korean, Vietnamese, Hindi, Arabic, Japanese, Russian)

==================================================
 PERPLEXITY QUALITY SCORECARD
 Base Model PPL      : 6.1097 (16-bit reference)
 Quantized Model PPL : 6.2049 (IQ4_NL target)
 Perplexity Drift    : +0.0952 (+1.56%)
 Quality Assessment  : [PASS] EXCELLENT (Near-Lossless / Gold Standard)
==================================================

What is Nemotron? NVIDIA Nemotron™ is a family of open models with open weights, training data, and recipes, delivering leading efficiency and accuracy for building specialized AI agents.

Description NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 is a large language model (LLM) trained by NVIDIA. This is the full-precision (BF16) release of Nemotron 3.5 Lightning — the reference weights of the model, intended primarily as the starting point for customization: post-training (SFT, RL, distillation), domain adaptation, and producing your own quantized or GGUF variants. For latency- and throughput-optimized inference, use the NVFP4 release instead.

The model employs a hybrid Mixture-of-Experts architecture, utilizing interleaved Mamba-2 and MoE layers, along with select Attention layers. The Lightning 3.5 model is released alongside a number of speculative decoding methods for faster text generation. The model has 3B active parameters and 30B parameters in total.

This model is ready for commercial use.

SOURCES:

• https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16

• https://huggingface.co/unsloth/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-GGUF

• https://huggingface.co/datasets/eaddario/imatrix-calibration