Ternary Bonsai: 1.58-bit Language Models at 8B, 4B, and 1.7B Scale.
1,337 Pulls 4 Tags Updated 1 month ago
Base model: https://huggingface.co/prism-ml/Bonsai-27B-gguf --- Bonsai 27b 4bits. Fully working with OpenCode and Cline. Default context 32k.
186 Pulls 1 Tag Updated 1 week ago