Tags · krith/phi-3.5-mini-instruct

krith/

phi-3.5-mini-instruct

75 Downloads Updated 11 months ago

I-quants for phi-3.5-mini-instruct

Name

4 models

Size

Context

Input

phi-3.5-mini-instruct:IQ3_M

bdc12be891cf • 1.9GB • 4K context window • Text input • 11 months ago

Text input • 11 months ago

phi-3.5-mini-instruct:IQ3_M

1.9GB

4K

Text

bdc12be891cf · 11 months ago

phi-3.5-mini-instruct:IQ2_M

3b97b435361f • 1.3GB • 4K context window • Text input • 11 months ago

Text input • 11 months ago

phi-3.5-mini-instruct:IQ2_M

1.3GB

4K

Text

3b97b435361f · 11 months ago

phi-3.5-mini-instruct:IQ3_XS

44f869f462c2 • 1.6GB • 4K context window • Text input • 11 months ago

Text input • 11 months ago

phi-3.5-mini-instruct:IQ3_XS

1.6GB

4K

Text

44f869f462c2 · 11 months ago

phi-3.5-mini-instruct:IQ4_XS

f5a6d09113b6 • 2.1GB • 4K context window • Text input • 11 months ago

Text input • 11 months ago

phi-3.5-mini-instruct:IQ4_XS

2.1GB

4K

Text

f5a6d09113b6 · 11 months ago