thanks to bartowski for quants on HF
140 Pulls Updated 5 months ago
Updated 5 months ago
5 months ago
69b5679ded76 · 4.8GB
model
archllama
·
parameters14B
·
quantizationIQ2_M
4.8GB
params
{"num_ctx":4096,"stop":["\u003c|im_start|\u003e","\u003c|im_end|\u003e"]}
74B
template
{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{ if .Prompt }}<|im_start|>user
181B
Readme
Original Quants on HF: bartowski/dolphin-2.9.2-Phi-3-Medium-GGUF
Original Model on HF: cognitivecomputations/dolphin-2.9.2-Phi-3-Medium
Discord: https://discord.gg/cognitivecomputations