A commercial-friendly small language model by NVIDIA optimized for roleplay, RAG QA, and function calling.
tools
4b
36.5K Pulls Updated 7 weeks ago
Updated 7 weeks ago
7 weeks ago
899020cd5b1e · 2.5GB
model
archnemotron
·
parameters4.19B
·
quantizationQ3_K_L
2.5GB
template
{{- if (or .Tools .System) }}<extra_id_0>System
{{ if .System }}{{ .System }}
{{ end }}
{{- if .To
773B
license
NVIDIA AI Foundation Models Community License Agreement
IMPORTANT NOTICE – PLEASE READ AND AGREE B
15kB
Readme
Nemotron-Mini-4B-Instruct is a model for generating responses for roleplaying, retrieval augmented generation, and function calling. It is a small language model (SLM) optimized through distillation, pruning and quantization for speed and on-device deployment.
This instruct model is optimized for roleplay, RAG QA, and function calling in English. It supports a context length of 4,096 tokens. This model is ready for commercial use.