tobestyledintro/ Ternary-Bonsai-2-27B

13K 1 month ago

Mirror of Prism ML's Bonsai 2 27B ternary GGUF packs (PQ2_0 and PTQ1_0): a 27B hybrid-attention reasoning model in 6.70 GiB or 5.53 GiB, 262K context, vision and tool calling, Apache-2.0. Requires Prism ML's llama.cpp fork — stock Ollama cannot load

vision tools thinking 27b

11 models

Ternary-Bonsai-2-27B:latest
0b2cbca12243 • 7.8GB • 256K context window •
Text, Image input • 1 month ago
Ternary-Bonsai-2-27B:pq2_0
0b2cbca12243 • 7.8GB • 256K context window •
Text, Image input • 1 month ago
Ternary-Bonsai-2-27B:ptq1_0
63fef38efac0 • 6.6GB • 256K context window •
Text, Image input • 1 month ago
Ternary-Bonsai-2-27B:vision
0b2cbca12243 • 7.8GB • 256K context window •
Text, Image input • 1 month ago
Ternary-Bonsai-2-27B:27b latest
0b2cbca12243 • 7.8GB • 256K context window •
Text, Image input • 1 month ago
Ternary-Bonsai-2-27B:f16
08de46758bfa • 54GB • 256K context window •
Text, Image input • 1 month ago
Ternary-Bonsai-2-27B:27b-mmproj-q8_0
0b2cbca12243 • 7.8GB • 256K context window •
Text, Image input • 1 month ago
Ternary-Bonsai-2-27B:27b-mmproj-bf16
c890ae7bacff • 8.1GB • 256K context window •
Text, Image input • 1 month ago
Ternary-Bonsai-2-27B:27b-pq2_0
0b2cbca12243 • 7.8GB • 256K context window •
Text, Image input • 1 month ago
Ternary-Bonsai-2-27B:27b-ptq1_0
63fef38efac0 • 6.6GB • 256K context window •
Text, Image input • 1 month ago
Ternary-Bonsai-2-27B:27b-f16
08de46758bfa • 54GB • 256K context window •
Text, Image input • 1 month ago