Tags · krith/meta-llama-3.1-70b-instruct-abliterated

krith/ meta-llama-3.1-70b-instruct-abliterated

1,136 Downloads Updated 2 years ago

I-quants for meta-llama-3.1-70b-instruct-abliterated

tools

Name

6 models

Size / Usage

Context

Input

meta-llama-3.1-70b-instruct-abliterated:IQ3_M

69362eb5a06e • 32GB • 128K context window • Text input • 2 years ago

Text input • 2 years ago

meta-llama-3.1-70b-instruct-abliterated:IQ3_M

32GB

128K

Text

69362eb5a06e · 2 years ago

meta-llama-3.1-70b-instruct-abliterated:IQ2_XXS

20e88e5afa27 • 19GB • 128K context window • Text input • 2 years ago

Text input • 2 years ago

meta-llama-3.1-70b-instruct-abliterated:IQ2_XXS

19GB

128K

Text

20e88e5afa27 · 2 years ago

meta-llama-3.1-70b-instruct-abliterated:IQ2_XS

cf89b173ca74 • 21GB • 128K context window • Text input • 2 years ago

Text input • 2 years ago

meta-llama-3.1-70b-instruct-abliterated:IQ2_XS

21GB

128K

Text

cf89b173ca74 · 2 years ago

meta-llama-3.1-70b-instruct-abliterated:IQ2_M

e6aecef87837 • 24GB • 128K context window • Text input • 2 years ago

Text input • 2 years ago

meta-llama-3.1-70b-instruct-abliterated:IQ2_M

24GB

128K

Text

e6aecef87837 · 2 years ago

meta-llama-3.1-70b-instruct-abliterated:IQ3_XXS

8446612f629a • 27GB • 128K context window • Text input • 2 years ago

Text input • 2 years ago

meta-llama-3.1-70b-instruct-abliterated:IQ3_XXS

27GB

128K

Text

8446612f629a · 2 years ago

meta-llama-3.1-70b-instruct-abliterated:IQ4_XS

54cac74f7c0a • 38GB • 128K context window • Text input • 2 years ago

Text input • 2 years ago

meta-llama-3.1-70b-instruct-abliterated:IQ4_XS

38GB

128K

Text

54cac74f7c0a · 2 years ago