199 Downloads Updated 1 year ago
thanks to bartowski for quants on HF
Models
View all →Name
18 models
dolphin-2.9.2-phi-3-medium:latest
8.4GB · 4K context window · Text · 1 year ago
dolphin-2.9.2-phi-3-medium:iq3_m
6.3GB · 4K context window · Text · 1 year ago
dolphin-2.9.2-phi-3-medium:q2_k
5.2GB · 4K context window · Text · 1 year ago
dolphin-2.9.2-phi-3-medium:q3_k_s
6.1GB · 4K context window · Text · 1 year ago
dolphin-2.9.2-phi-3-medium:q3_k_m
6.8GB · 4K context window · Text · 1 year ago
dolphin-2.9.2-phi-3-medium:q3_k_l
7.3GB · 4K context window · Text · 1 year ago
dolphin-2.9.2-phi-3-medium:q4_k_s
8.0GB · 4K context window · Text · 1 year ago
dolphin-2.9.2-phi-3-medium:q4_k_m
8.4GB · 4K context window · Text · 1 year ago
dolphin-2.9.2-phi-3-medium:q5_k_s
9.6GB · 4K context window · Text · 1 year ago
dolphin-2.9.2-phi-3-medium:q5_k_m
9.9GB · 4K context window · Text · 1 year ago
dolphin-2.9.2-phi-3-medium:q6_k
11GB · 4K context window · Text · 1 year ago
dolphin-2.9.2-phi-3-medium:q8_0
15GB · 4K context window · Text · 1 year ago
dolphin-2.9.2-phi-3-medium:iq2_xs
4.2GB · 4K context window · Text · 1 year ago
dolphin-2.9.2-phi-3-medium:iq2_s
4.4GB · 4K context window · Text · 1 year ago
dolphin-2.9.2-phi-3-medium:iq2_m
4.8GB · 4K context window · Text · 1 year ago
dolphin-2.9.2-phi-3-medium:iq3_xxs
5.4GB · 4K context window · Text · 1 year ago
dolphin-2.9.2-phi-3-medium:iq3_xs
5.8GB · 4K context window · Text · 1 year ago
dolphin-2.9.2-phi-3-medium:iq4_xs
7.5GB · 4K context window · Text · 1 year ago
Readme
Original Quants on HF: bartowski/dolphin-2.9.2-Phi-3-Medium-GGUF
Original Model on HF: cognitivecomputations/dolphin-2.9.2-Phi-3-Medium
Discord: https://discord.gg/cognitivecomputations