dagbs / dolphin-2.9.2-phi-3-medium

thanks to bartowski for quants on HF

128 Pulls Updated 3 months ago

Updated 3 months ago

3 months ago

f7e85c3c22dc · 8.4GB

parameters14.0B

quantizationQ4_K_M

{"num_ctx":4096,"stop":["<|im_start|>","<|im_end|>"]}

{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user {{ .Prompt }}<|im_end|> {{ end }}<|im_start|>assistant {{ .Response }}<|im_end|>

Readme

Original Quants on HF: bartowski/dolphin-2.9.2-Phi-3-Medium-GGUF

Original Model on HF: cognitivecomputations/dolphin-2.9.2-Phi-3-Medium

Discord: https://discord.gg/cognitivecomputations