freerainboxbox/phi4:14b-q3_K

freerainboxbox/

phi4:14b-q3_K_S

142 Downloads Updated 9 months ago

Alternative quantization levels, no fine-tuning

Updated 9 months ago

9 months ago

c0d3350e2d23 · 6.5GB ·

archphi3

parameters14.7B

quantizationQ3_K_S

6.5GB

Microsoft. Copyright (c) Microsoft Corporation. MIT License Permission is hereby granted, free of ch

1.1kB

{ "stop": [ "<|im_start|>", "<|im_end|>", "<|im_sep|>" ] }

82B

{{- range $i, $_ := .Messages }} {{- $last := eq (len (slice $.Messages $i)) 1 -}} <|im_start|>{{ .R

275B

These are alternative quantization levels from Microsoft’s phi4. No fine-tuning has been done, these are purely quantized.