pparikh2/ phi3.5Q4_K_M:latest

505 12 months ago

Quantized version of Phi3.5 mini-instruct with Q4_K_M quatization method using gguf

... /
template
c608dc615584 · 149B
{{ if .System }}<|system|>
{{ .System }}<|end|>
{{ end }}{{ if .Prompt }}<|user|>
{{ .Prompt }}<|end|>
{{ end }}<|assistant|>
{{ .Response }}<|end|>