krith/
llama-3.3-70b-instruct

418 8 months ago

I-quants for llama-3.3-70b-instruct

tools

11 models

llama-3.3-70b-instruct:IQ3_M
64679b459fc8 • 32GB • 128K context window •
Text input • 8 months ago
llama-3.3-70b-instruct:IQ1_S
9d22375c6dc8 • 15GB • 128K context window •
Text input • 8 months ago
llama-3.3-70b-instruct:IQ1_M
faa3ee74fef5 • 17GB • 128K context window •
Text input • 8 months ago
llama-3.3-70b-instruct:IQ2_XXS
380f951366a0 • 19GB • 128K context window •
Text input • 8 months ago
llama-3.3-70b-instruct:IQ2_XS
833453cd584b • 21GB • 128K context window •
Text input • 8 months ago
llama-3.3-70b-instruct:IQ2_S
30346739897c • 22GB • 128K context window •
Text input • 8 months ago
llama-3.3-70b-instruct:IQ2_M
17f6a9674949 • 24GB • 128K context window •
Text input • 8 months ago
llama-3.3-70b-instruct:IQ3_XXS
ca24e2a09185 • 27GB • 128K context window •
Text input • 8 months ago
llama-3.3-70b-instruct:IQ3_XS
1ec6c47a248e • 29GB • 128K context window •
Text input • 8 months ago
llama-3.3-70b-instruct:IQ3_S
79a979927f74 • 31GB • 128K context window •
Text input • 8 months ago
llama-3.3-70b-instruct:IQ4_XS
4891e45af5b9 • 38GB • 128K context window •
Text input • 9 months ago