krith/
phi-3.5-mini-instruct

80 1 year ago

I-quants for phi-3.5-mini-instruct

Models

View all →

4 models

phi-3.5-mini-instruct:IQ3_M

1.9GB · 4K context window · Text · 1 year ago

phi-3.5-mini-instruct:IQ2_M

1.3GB · 4K context window · Text · 1 year ago

phi-3.5-mini-instruct:IQ3_XS

1.6GB · 4K context window · Text · 1 year ago

phi-3.5-mini-instruct:IQ4_XS

2.1GB · 4K context window · Text · 1 year ago

Readme

Created using GGUF files from https://huggingface.co/bartowski/Phi-3.5-mini-instruct-GGUF