krith/
llama-3.1-nemotron-70b-instruct-hf:IQ2_XS

229 1 year ago

I-quants for llama-3.1-nemotron-70b-instruct-hf

tools

1 year ago

2c04f2d0f330 · 21GB ·

model
llama
·
70.6B
·
IQ2_XS
params
{ "stop": [ "<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"
license
LLAMA 3.1 COMMUNITY LICENSE AGREEMENT Llama 3.1 Version Release Date: July 23, 2024 “Agreement”
template
<|start_header_id|>system<|end_header_id|> {{ if .Tools }}You have access to the following functions

Readme

Created using GGUF files from https://huggingface.co/bartowski/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF