vanilj / llama3.1-70b-iquants

Llama 3.1 70b IQs: IQ1_M, IQ2_M, IQ2_S, IQ2_XS, IQ2_XXS, IQ3_XS, IQ4_XS

tools

97 Pulls Updated 3 months ago

8 Tags

c7a4b60d3c5c • 17GB • 3 months ago

1764159a3b35 • 24GB • 3 months ago

1d21007706dc • 22GB • 3 months ago

b62cbba7f548 • 21GB • 3 months ago

c0d210b2914d • 19GB • 3 months ago

7c1ace0dc631 • 32GB • 3 months ago

c03fbeb72cf4 • 29GB • 3 months ago

7153e9b4a27a • 38GB • 3 months ago