dagbs/dolphin-2.9.2-phi-3-medium:q6_k

dagbs/

dolphin-2.9.2-phi-3-medium

thanks to bartowski for quants on HF

169 Pulls Updated 9 months ago

Updated 9 months ago

9 months ago

dc1138b4ad7f · 11GB

quantizationQ6_K

{ "num_ctx": 4096, "stop": [ "<|im_start|>", "<|im_end|>" ] }

{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user

Readme

Original Quants on HF: bartowski/dolphin-2.9.2-Phi-3-Medium-GGUF

Original Model on HF: cognitivecomputations/dolphin-2.9.2-Phi-3-Medium

Discord: https://discord.gg/cognitivecomputations