thanks to bartowski for quants on HF
143 Pulls Updated 5 months ago
Updated 5 months ago
5 months ago
f7e85c3c22dc · 8.4GB
model
archllama
·
parameters14B
·
quantizationQ4_K_M
8.4GB
params
{"num_ctx":4096,"stop":["\u003c|im_start|\u003e","\u003c|im_end|\u003e"]}
74B
template
{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{ if .Prompt }}<|im_start|>user
181B
Readme
Original Quants on HF: bartowski/dolphin-2.9.2-Phi-3-Medium-GGUF
Original Model on HF: cognitivecomputations/dolphin-2.9.2-Phi-3-Medium
Discord: https://discord.gg/cognitivecomputations