freerainboxbox/ phi4

221 1 year ago

Alternative quantization levels, no fine-tuning

11 models

phi4:14b-q3_K_S
c0d3350e2d23 • 6.5GB • 16K context window •
Text input • 1 year ago
phi4:14b-q3_K_M
07a380aafbb4 • 7.4GB • 16K context window •
Text input • 1 year ago
phi4:14b-q3_K_L
683192fa898c • 7.9GB • 16K context window •
Text input • 1 year ago
phi4:14b-q4_0
dac25ac6139c • 8.4GB • 16K context window •
Text input • 1 year ago
phi4:14b-q4_1
4860b343b0cd • 9.3GB • 16K context window •
Text input • 1 year ago
phi4:14b-q4_K_S
02cedb8761b2 • 8.4GB • 16K context window •
Text input • 1 year ago
phi4:14b-q5_0
03b1d10528c5 • 10GB • 16K context window •
Text input • 1 year ago
phi4:14b-q5_1
7d2108ebe65a • 11GB • 16K context window •
Text input • 1 year ago
phi4:14b-q5_K_S
e754261a3e9f • 10GB • 16K context window •
Text input • 1 year ago
phi4:14b-q5_K_M
7cf8ec1183c5 • 11GB • 16K context window •
Text input • 1 year ago
phi4:14b-q6_K
be81bcdbb01e • 12GB • 16K context window •
Text input • 1 year ago