Llama 3.1 70b IQs: IQ1_M, IQ2_M, IQ2_S, IQ2_XS, IQ2_XXS, IQ3_XS, IQ4_XS

tools

107 3 months ago

8 Tags
c7a4b60d3c5c • 17GB • 3 months ago
1764159a3b35 • 24GB • 3 months ago
1d21007706dc • 22GB • 3 months ago
b62cbba7f548 • 21GB • 3 months ago
c0d210b2914d • 19GB • 3 months ago
7c1ace0dc631 • 32GB • 3 months ago
c03fbeb72cf4 • 29GB • 3 months ago
7153e9b4a27a • 38GB • 3 months ago