technobyte / llama-3.1-nemotron-70b-instruct

LLM customized by NVIDIA to improve the helpfulness of generated responses #1 on all three automatic alignment benchmarks (verified tab for AlpacaEval 2 LC), edging out strong frontier models such as GPT-4o and Claude 3.5 Sonnet.

70B

38 Pulls Updated 2 hours ago

2 hours ago

798e7c68580c · 21GB

model
llama
·
70.6B
·
IQ2_XS
template
{{ if .System }}<|start_header_id|>system<|end_header_id|> {{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|> {{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|> {{ .Response }}<|eot_id|>
params
{"num_ctx":5120,"stop":["<|start_header_id|>","<|end_header_id|>","<|eot_id|>"]}

Readme

No readme