krith/
mistral-small-instruct-2409

172 1 year ago

I-quants for mistral-small-instruct-2409

tools

Models

View all →

6 models

mistral-small-instruct-2409:IQ3_M

10GB · 128K context window · Text · 1 year ago

mistral-small-instruct-2409:IQ2_XXS

6.0GB · 128K context window · Text · 1 year ago

mistral-small-instruct-2409:IQ2_XS

6.6GB · 128K context window · Text · 1 year ago

mistral-small-instruct-2409:IQ2_M

7.6GB · 128K context window · Text · 1 year ago

mistral-small-instruct-2409:IQ3_XS

9.2GB · 128K context window · Text · 1 year ago

mistral-small-instruct-2409:IQ4_XS

12GB · 128K context window · Text · 1 year ago

Readme

Created using GGUF files from https://huggingface.co/bartowski/Mistral-Small-Instruct-2409-GGUF