Tags · krith/llama-3.1-nemotron-70b-instruct-hf

krith/ llama-3.1-nemotron-70b-instruct-hf

277 Downloads Updated 2 years ago

I-quants for llama-3.1-nemotron-70b-instruct-hf

tools

Name

7 models

Size / Usage

Context

Input

llama-3.1-nemotron-70b-instruct-hf:IQ3_M

c9f9fb27b43c • 32GB • 128K context window • Text input • 2 years ago

Text input • 2 years ago

llama-3.1-nemotron-70b-instruct-hf:IQ3_M

32GB

128K

Text

c9f9fb27b43c · 2 years ago

llama-3.1-nemotron-70b-instruct-hf:IQ1_M

672184de55a3 • 17GB • 128K context window • Text input • 2 years ago

Text input • 2 years ago

llama-3.1-nemotron-70b-instruct-hf:IQ1_M

17GB

128K

Text

672184de55a3 · 2 years ago

llama-3.1-nemotron-70b-instruct-hf:IQ2_XXS

53d54f24fa09 • 19GB • 128K context window • Text input • 2 years ago

Text input • 2 years ago

llama-3.1-nemotron-70b-instruct-hf:IQ2_XXS

19GB

128K

Text

53d54f24fa09 · 2 years ago

llama-3.1-nemotron-70b-instruct-hf:IQ2_XS

2c04f2d0f330 • 21GB • 128K context window • Text input • 2 years ago

Text input • 2 years ago

llama-3.1-nemotron-70b-instruct-hf:IQ2_XS

21GB

128K

Text

2c04f2d0f330 · 2 years ago

llama-3.1-nemotron-70b-instruct-hf:IQ2_M

2ebd89c845f6 • 24GB • 128K context window • Text input • 2 years ago

Text input • 2 years ago

llama-3.1-nemotron-70b-instruct-hf:IQ2_M

24GB

128K

Text

2ebd89c845f6 · 2 years ago

llama-3.1-nemotron-70b-instruct-hf:IQ3_XXS

36df1019b323 • 27GB • 128K context window • Text input • 2 years ago

Text input • 2 years ago

llama-3.1-nemotron-70b-instruct-hf:IQ3_XXS

27GB

128K

Text

36df1019b323 · 2 years ago

llama-3.1-nemotron-70b-instruct-hf:IQ4_XS

b5ee52b59644 • 38GB • 128K context window • Text input • 2 years ago

Text input • 2 years ago

llama-3.1-nemotron-70b-instruct-hf:IQ4_XS

38GB

128K

Text

b5ee52b59644 · 2 years ago