krith/
meta-llama-3.1-8b-instruct

192 1 year ago

I-quants for meta-llama-3.1-8b-instruct

tools

Models

View all →

11 models

meta-llama-3.1-8b-instruct:IQ3_M

3.8GB · 128K context window · Text · 1 year ago

meta-llama-3.1-8b-instruct:IQ1_S

2.0GB · 128K context window · Text · 1 year ago

meta-llama-3.1-8b-instruct:IQ1_M

2.2GB · 128K context window · Text · 1 year ago

meta-llama-3.1-8b-instruct:IQ2_XXS

2.4GB · 128K context window · Text · 1 year ago

meta-llama-3.1-8b-instruct:IQ2_XS

2.6GB · 128K context window · Text · 1 year ago

meta-llama-3.1-8b-instruct:IQ2_S

2.8GB · 128K context window · Text · 1 year ago

meta-llama-3.1-8b-instruct:IQ2_M

2.9GB · 128K context window · Text · 1 year ago

meta-llama-3.1-8b-instruct:IQ3_XXS

3.3GB · 128K context window · Text · 1 year ago

meta-llama-3.1-8b-instruct:IQ3_XS

3.5GB · 128K context window · Text · 1 year ago

meta-llama-3.1-8b-instruct:IQ3_S

3.7GB · 128K context window · Text · 1 year ago

meta-llama-3.1-8b-instruct:IQ4_XS

4.4GB · 128K context window · Text · 1 year ago

Readme

Created using GGUF files from https://huggingface.co/ThomasBaruzier/Meta-Llama-3.1-8B-Instruct-GGUF