freerainboxbox/
phi4

142 9 months ago

Alternative quantization levels, no fine-tuning

Models

View all →

11 models

phi4:14b-q3_K_S

6.5GB · 16K context window · Text · 9 months ago

phi4:14b-q3_K_M

7.4GB · 16K context window · Text · 9 months ago

phi4:14b-q3_K_L

7.9GB · 16K context window · Text · 9 months ago

phi4:14b-q4_0

8.4GB · 16K context window · Text · 9 months ago

phi4:14b-q4_1

9.3GB · 16K context window · Text · 9 months ago

phi4:14b-q4_K_S

8.4GB · 16K context window · Text · 9 months ago

phi4:14b-q5_0

10GB · 16K context window · Text · 9 months ago

phi4:14b-q5_1

11GB · 16K context window · Text · 9 months ago

phi4:14b-q5_K_S

10GB · 16K context window · Text · 9 months ago

phi4:14b-q5_K_M

11GB · 16K context window · Text · 9 months ago

phi4:14b-q6_K

12GB · 16K context window · Text · 9 months ago

Readme

These are alternative quantization levels from Microsoft’s phi4. No fine-tuning has been done, these are purely quantized.