thanks to bartowski for quants on HF
140 Pulls Updated 5 months ago
Updated 5 months ago
5 months ago
50624dc3dad6 · 5.8GB
model
archllama
·
parameters14B
·
quantizationIQ3_XS
5.8GB
params
{"num_ctx":4096,"stop":["\u003c|im_start|\u003e","\u003c|im_end|\u003e"]}
74B
template
{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{ if .Prompt }}<|im_start|>user
181B
Readme
Original Quants on HF: bartowski/dolphin-2.9.2-Phi-3-Medium-GGUF
Original Model on HF: cognitivecomputations/dolphin-2.9.2-Phi-3-Medium
Discord: https://discord.gg/cognitivecomputations