krith/
llama-3.1-nemotron-70b-instruct-hf

223 10 months ago

I-quants for llama-3.1-nemotron-70b-instruct-hf

tools

7 models

llama-3.1-nemotron-70b-instruct-hf:IQ3_M
c9f9fb27b43c • 32GB • 128K context window •
Text input • 10 months ago
llama-3.1-nemotron-70b-instruct-hf:IQ1_M
672184de55a3 • 17GB • 128K context window •
Text input • 10 months ago
llama-3.1-nemotron-70b-instruct-hf:IQ2_XXS
53d54f24fa09 • 19GB • 128K context window •
Text input • 10 months ago
llama-3.1-nemotron-70b-instruct-hf:IQ2_XS
2c04f2d0f330 • 21GB • 128K context window •
Text input • 10 months ago
llama-3.1-nemotron-70b-instruct-hf:IQ2_M
2ebd89c845f6 • 24GB • 128K context window •
Text input • 10 months ago
llama-3.1-nemotron-70b-instruct-hf:IQ3_XXS
36df1019b323 • 27GB • 128K context window •
Text input • 10 months ago
llama-3.1-nemotron-70b-instruct-hf:IQ4_XS
b5ee52b59644 • 38GB • 128K context window •
Text input • 10 months ago