72.8K Downloads Updated 7 months ago
Llama-3.1-Nemotron-70B-Instruct is a large language model customized by NVIDIA to improve the helpfulness of LLM generated responses to user queries.
tools
70b
17 models
nemotron:latest
2262f047a28a • 43GB •
128K context window •
Text input •
7 months ago
Text input •
7 months ago
2262f047a28a · 7 months ago
nemotron:70b
latest
2262f047a28a • 43GB •
128K context window •
Text input •
7 months ago
Text input •
7 months ago
2262f047a28a · 7 months ago
nemotron:70b-instruct-q2_K
f4743c4c6e52 • 26GB •
128K context window •
Text input •
7 months ago
Text input •
7 months ago
f4743c4c6e52 · 7 months ago
nemotron:70b-instruct-q3_K_S
49258a4a766a • 31GB •
128K context window •
Text input •
7 months ago
Text input •
7 months ago
49258a4a766a · 7 months ago
nemotron:70b-instruct-q3_K_M
a0a786c3dc39 • 34GB •
128K context window •
Text input •
7 months ago
Text input •
7 months ago
a0a786c3dc39 · 7 months ago
nemotron:70b-instruct-q3_K_L
a6c94d07d7c9 • 37GB •
128K context window •
Text input •
7 months ago
Text input •
7 months ago
a6c94d07d7c9 · 7 months ago
nemotron:70b-instruct-q4_0
aade1b26eba3 • 40GB •
128K context window •
Text input •
7 months ago
Text input •
7 months ago
aade1b26eba3 · 7 months ago
nemotron:70b-instruct-q4_1
c463f99d4c5e • 44GB •
128K context window •
Text input •
7 months ago
Text input •
7 months ago
c463f99d4c5e · 7 months ago
nemotron:70b-instruct-q4_K_S
0e32f30ad742 • 40GB •
128K context window •
Text input •
7 months ago
Text input •
7 months ago
0e32f30ad742 · 7 months ago
nemotron:70b-instruct-q4_K_M
2262f047a28a • 43GB •
128K context window •
Text input •
7 months ago
Text input •
7 months ago
2262f047a28a · 7 months ago
nemotron:70b-instruct-q5_0
4c83a56211a0 • 49GB •
128K context window •
Text input •
7 months ago
Text input •
7 months ago
4c83a56211a0 · 7 months ago
nemotron:70b-instruct-q5_1
32ce9fe7477b • 53GB •
128K context window •
Text input •
7 months ago
Text input •
7 months ago
32ce9fe7477b · 7 months ago
nemotron:70b-instruct-q5_K_S
c5dfebb28f5f • 49GB •
128K context window •
Text input •
7 months ago
Text input •
7 months ago
c5dfebb28f5f · 7 months ago
nemotron:70b-instruct-q5_K_M
def2cefbe818 • 50GB •
128K context window •
Text input •
7 months ago
Text input •
7 months ago
def2cefbe818 · 7 months ago
nemotron:70b-instruct-q6_K
8d12c48f836a • 58GB •
128K context window •
Text input •
7 months ago
Text input •
7 months ago
8d12c48f836a · 7 months ago
nemotron:70b-instruct-q8_0
8865b9ab3285 • 75GB •
128K context window •
Text input •
7 months ago
Text input •
7 months ago
8865b9ab3285 · 7 months ago