dagbs/dolphin-2.9.2-phi-3-medium:iq2_s

dagbs/

dolphin-2.9.2-phi-3-medium:iq2_s

199 Downloads Updated 1 year ago

thanks to bartowski for quants on HF

Updated 1 year ago

1 year ago

df28eb78e7f8 · 4.4GB ·

archllama

·

parameters14B

·

quantizationIQ4_XS

4.4GB

{ "num_ctx": 4096, "stop": [ "<|im_start|>", "<|im_end|>" ] }

74B

{{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user

181B

Readme

Original Quants on HF: bartowski/dolphin-2.9.2-Phi-3-Medium-GGUF

Original Model on HF: cognitivecomputations/dolphin-2.9.2-Phi-3-Medium

Discord: https://discord.gg/cognitivecomputations