wojtek/ kappa3-phi3

137 2 years ago

Quantizations of failspy/kappa-3-phi-3-4k-instruct-abliterated-GGUF

4 models

kappa3-phi3:3.8b-mini-4k-instruct-q4_K_M
8aa5ac64d8cc • 2.4GB • 4K context window •
Text input • 2 years ago
kappa3-phi3:3.8b-mini-4k-instruct-q5_K_M
e9f71ed6ba85 • 2.8GB • 4K context window •
Text input • 2 years ago
kappa3-phi3:3.8b-mini-4k-instruct-q6_K
610abee09f81 • 3.1GB • 4K context window •
Text input • 2 years ago
kappa3-phi3:3.8b-mini-4k-instruct-q8_0
2efffcadc31c • 4.1GB • 4K context window •
Text input • 2 years ago