vanilj/ llama3.1-70b-iquants

265 2 years ago

Llama 3.1 70b IQs: IQ1_M, IQ2_M, IQ2_S, IQ2_XS, IQ2_XXS, IQ3_XS, IQ4_XS

tools

8 models

llama3.1-70b-iquants:IQ3_M
7c1ace0dc631 • 32GB • 128K context window •
Text input • 2 years ago
llama3.1-70b-iquants:IQ1_M
c7a4b60d3c5c • 17GB • 128K context window •
Text input • 2 years ago
llama3.1-70b-iquants:IQ2_XXS
c0d210b2914d • 19GB • 128K context window •
Text input • 2 years ago
llama3.1-70b-iquants:IQ2_XS
b62cbba7f548 • 21GB • 128K context window •
Text input • 2 years ago
llama3.1-70b-iquants:IQ2_S
1d21007706dc • 22GB • 128K context window •
Text input • 2 years ago
llama3.1-70b-iquants:IQ2_M
1764159a3b35 • 24GB • 128K context window •
Text input • 2 years ago
llama3.1-70b-iquants:IQ3_XS
c03fbeb72cf4 • 29GB • 128K context window •
Text input • 2 years ago
llama3.1-70b-iquants:IQ4_XS
7153e9b4a27a • 38GB • 128K context window •
Text input • 2 years ago