505 12 months ago

Quantized version of Phi3.5 mini-instruct with Q4_K_M quatization method using gguf

ollama run pparikh2/phi3.5Q4_K_M

Details

12 months ago

8a2aeb3d19d1 · 2.4GB ·

phi3
·
3.82B
·
Q4_K_M
{ "stop": [ "<|system|>", "<|user|>", "<|end|>", "<|assistant|>"
{{ if .System }}<|system|> {{ .System }}<|end|> {{ end }}{{ if .Prompt }}<|user|> {{ .Prompt }}<|end

Readme

No readme